Jun 29 04:37:00 devstack cinder-volume[82685]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 29 04:37:00 devstack cinder-volume[82685]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 29 04:37:00 devstack cinder-volume[82685]: we strongly recommend against using it for new projects.
Jun 29 04:37:00 devstack cinder-volume[82685]: If you are already using Eventlet, we recommend migrating to a different
Jun 29 04:37:00 devstack cinder-volume[82685]: framework.  For more detail see
Jun 29 04:37:00 devstack cinder-volume[82685]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 29 04:37:00 devstack cinder-volume[82685]:   import eventlet  # noqa
Jun 29 04:37:02 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:37:02 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:37:02 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:37:03 devstack cinder-volume[82685]: INFO dbcounter [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Registered counter for database cinder
Jun 29 04:37:03 devstack cinder-volume[82685]: DEBUG oslo_db.sqlalchemy.engines [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG dbcounter [-] [82685] Writer thread running {{(pid=82685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.rpc [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.rpc [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG oslo_db.sqlalchemy.engines [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.volume.manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Determined volume DB was empty at startup.
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG cinder.volume.manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82685) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.volume.manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 29 04:37:04 devstack cinder-volume[82685]: WARNING stevedore.named [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 29 04:37:04 devstack cinder-volume[82685]: WARNING castellan.key_manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:37:04 devstack cinder-volume[82685]: WARNING cinder.keymgr.conf_key_mgr [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG cinder.volume.drivers.lvm [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82685) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG oslo_concurrency.processutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG oslo_concurrency.processutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=82685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG oslo_db.sqlalchemy.engines [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.rpc [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.rpc [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 29 04:37:04 devstack cinder-volume[82685]: WARNING stevedore.named [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 29 04:37:04 devstack cinder-volume[82685]: WARNING castellan.key_manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:37:04 devstack cinder-volume[82685]: INFO cinder.volume.manager [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 29 04:37:04 devstack cinder-volume[82685]: DEBUG oslo_db.sqlalchemy.engines [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:37:05 devstack cinder-volume[82685]: INFO oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Starting 1 workers
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Started child 82855 {{(pid=82685) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Full set of CONF: {{(pid=82685) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] ******************************************************************************** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Configuration options gathered from: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] ================================================================================ {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] allow_availability_zone_fallback = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] allow_compression_on_image_upload = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] allowed_direct_url_schemes     = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] api_rate_limit                 = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] auth_strategy                  = keystone {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] az_cache_duration              = 3600 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_availability_zone      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_host                   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_name                   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_stats_polling_interval = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backup_api_class               = cinder.backup.api.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backup_name_template           = backup-%s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backup_use_same_host           = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backup_use_temp_snapshot       = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82855]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] chap_password                  = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] chap_username                  =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_internal_tenant_project_id = 4aea1c721e124dffbe6bbebff2c194f9 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_internal_tenant_user_id = ecc3bec222a844df8741ce8091d3e634 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cloned_volume_same_az          = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cluster                        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] compression_format             = gzip {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] config_dir                     = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] config_source                  = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] control_exchange               = openstack {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] debug                          = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] default_availability_zone      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] default_group_type             = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] default_volume_type            = lvmdriver-1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] disk_geometry                  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_client_cert             = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_client_cert_key         = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_data_namespace          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_ssl_cert_path           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_ssl_cert_verify         = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] driver_use_ssl                 = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] enable_force_upload            = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] enable_new_services            = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] enable_unsupported_driver      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] enforce_multipath_for_image_xfer = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] filter_function                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_api_insecure            = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_api_servers             = ['http://192.168.122.111/image'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_api_ssl_compression     = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_ca_certificates_file    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_certfile                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_keyfile                 = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_num_retries             = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance_request_timeout         = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] goodness_function              = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] graceful_shutdown_timeout      = 5 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] group_api_class                = cinder.group.api.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] host                           = devstack {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_compress_on_upload       = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_conversion_address_space_limit = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_conversion_cpu_limit     = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_conversion_disable       = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_upload_use_cinder_backend = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_upload_use_internal_tenant = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_volume_cache_enabled     = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_volume_cache_max_count   = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] image_volume_cache_max_size_gb = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] init_host_max_objects_retrieval = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iscsi_target_flags             =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iscsi_write_cache              = on {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iser_helper                    = tgtadm {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iser_ip_address                = 192.168.122.111 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iser_port                      = 3260 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_color                      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_config_append              = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_dir                        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_file                       = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_options                    = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_rotate_interval            = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_rotate_interval_type       = days {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] log_rotation_type              = none {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] max_age                        = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] max_logfile_count              = 30 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] max_logfile_size_mb            = 200 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] max_over_subscription_ratio    = 20.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] message_reap_interval          = 86400 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] message_ttl                    = 2592000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] migration_create_volume_timeout_secs = 300 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] monkey_patch                   = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] monkey_patch_modules           = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] my_ip                          = 192.168.122.111 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] no_snapshot_gb_quota           = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] num_iser_scan_tries            = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] num_shell_tries                = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] num_volume_device_scan_tries   = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] nvmeof_conn_info_version       = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] nvmet_ns_id                    = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] nvmet_port_id                  = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_max_limit                = 1000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_ext_list          = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_listen_port       = 8776 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_use_ssl           = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] osapi_volume_workers           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] per_volume_size_limit          = -1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] periodic_fuzzy_delay           = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] periodic_interval              = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] public_endpoint                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] publish_errors                 = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_backup_gigabytes         = 1000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_backups                  = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_gigabytes                = 1000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_groups                   = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_snapshots                = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] quota_volumes                  = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] rate_limit_burst               = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] rate_limit_except_level        = CRITICAL {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] rate_limit_interval            = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] reinit_driver_count            = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] replication_device             = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] report_discard_supported       = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] report_interval                = 120 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] reservation_clean_interval     = 86400 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] reservation_expire             = 86400 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] reserved_image_namespaces      = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] reserved_percentage            = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] rpc_response_timeout           = 120 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] run_external_periodic_tasks    = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] scst_target_driver             = iscsi {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] scst_target_iqn_name           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_down_time              = 720 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] shell_completion               = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] snapshot_name_template         = snapshot-%s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] snapshot_same_host             = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] split_loggers                  = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] state_path                     = /opt/stack/data/cinder {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] storage_availability_zone      = nova {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] storage_protocol               = iSCSI {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] syslog_log_facility            = LOG_USER {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_helper                  = lioadm {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_ip_address              = 192.168.122.111 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_port                    = 3260 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_protocol                = iscsi {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] target_secondary_ip_addresses  = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] trace_flags                    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] transport_url                  = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] until_refresh                  = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_chap_auth                  = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_default_quota_class        = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_journal                    = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_json                       = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_multipath_for_image_xfer   = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_stderr                     = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] use_syslog                     = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] verify_glance_signatures       = enabled {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_api_class               = cinder.volume.api.API {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_backend_name            = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_clear                   = zero {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_clear_ionice            = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_clear_size              = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_copy_bps_limit          = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_dd_blocksize            = 1M {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_name_template           = volume-%s {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_service_inithost_offload = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volume_usage_audit_period      = month {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] zoning_mode                    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: INFO cinder.volume.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.auth_section = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.auth_type   = password {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.auth_version = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.cache       = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.certfile    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.include_service_catalog = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.insecure    = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.interface   = public {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.keyfile     = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_password =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcache_username =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.region_name = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.service_type = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.backend                  = dogpile.cache.null {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.backend_argument         = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.backend_expiration_time  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.config_prefix            = cache.oslo {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.debug_cache_backend      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.enable_retry_client      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.enable_socket_keepalive  = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.enabled                  = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.expiration_time          = 600 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_dead_retry      = 300 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_sasl_enabled    = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.password                 = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.proxies                  = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.redis_db                 = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.redis_server             = localhost:6379 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.retry_attempts           = 2 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.retry_delay              = 0.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.socket_keepalive_count   = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.socket_keepalive_idle    = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.socket_keepalive_interval = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.socket_timeout           = 1.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.tls_allowed_ciphers      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.tls_cafile               = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.tls_certfile             = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.tls_enabled              = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.tls_keyfile              = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cache.username                 = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] coordination.backend_url       = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.asyncio_connection    = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.asyncio_slave_connection = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.backend               = sqlalchemy {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.connection            = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.connection_debug      = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.connection_parameters =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.connection_recycle_time = 3600 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.connection_trace      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.db_inc_retry_interval = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.db_max_retries        = 20 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.db_max_retry_interval = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.db_retry_interval     = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.max_overflow          = 50 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.max_pool_size         = 5 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.max_retries           = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.pool_timeout          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.retry_interval        = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.slave_connection      = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.sqlite_synchronous    = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.synchronous_reader    = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] database.use_db_reconnect      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.connection_string     = messaging:// {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.enabled               = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.es_doc_type           = notification {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.es_scroll_size        = 10000 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.es_scroll_time        = 2m {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.filter_error_trace    = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.hmac_keys             = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.sentinel_service_name = mymaster {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.socket_timeout        = 0.1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.trace_requests        = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler.trace_sqlalchemy      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler_jaeger.process_tags   = {} {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] profiler_otlp.service_name_prefix = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: WARNING oslo_config.cfg [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.enforce_scope      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.policy_default_rule = default {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.group          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.helper_command = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] privsep_osbrick.user           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.group         = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.helper_command = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] cinder_sys_admin.user          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.auth_section      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.auth_type         = password {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.cafile            = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.certfile          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.collect_timing    = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.insecure          = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.keyfile           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.send_service_user_token = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.split_loggers     = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] service_user.timeout           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.auth_section            = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.auth_type               = password {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.certfile                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.collect_timing          = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.insecure                = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.keyfile                 = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.region_name             = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.split_loggers           = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] glance.timeout                 = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.backend_availability_zone = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.chap_password = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.chap_username =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.disk_geometry = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_client_cert = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_client_cert_key = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_data_namespace = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.driver_use_ssl = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.extra_capabilities = {} {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.filter_function = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.goodness_function = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iscsi_target_flags =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iscsi_write_cache = on {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iser_port     = 3260 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.lvm_share_target = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack sudo[82859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.lvm_type      = auto {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.num_shell_tries = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.replication_device = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.report_discard_supported = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.reserved_percentage = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_helper = tgtadm {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_port   = 3260 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_protocol = iscsi {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.trace_flags   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.unique_fqdn_network = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.use_chap_auth = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_backend_name = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_clear  = zero {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_clear_ionice = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_clear_size = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_reports.file_event_handler = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_reports.log_dir           = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.backend_host       = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.chap_password      = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.chap_username      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.disk_geometry      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_client_cert = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.extra_capabilities = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.filter_function    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.goodness_function  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iser_helper        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iser_ip_address    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iser_port          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.lvm_share_target   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.lvm_type           = auto {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.num_shell_tries    = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.replication_device = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.report_discard_supported = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.reserved_percentage = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.scst_target_driver = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.storage_protocol   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_helper      = lioadm {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_ip_address  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_port        = 3260 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.trace_flags        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.use_chap_auth      = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_clear       = zero {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_clear_size  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] lvmdriver-1.volumes_dir        = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_notifications.driver = [] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] key_manager.fixed_key          = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.barbican_api_version  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.barbican_endpoint     = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.barbican_endpoint_type = public {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.barbican_region_name  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.cafile                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.certfile              = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.collect_timing        = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.insecure              = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.keyfile               = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.number_of_retries     = 60 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.retry_delay           = 1 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.send_service_user_token = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.split_loggers         = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.timeout               = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.verify_ssl            = True {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican.verify_ssl_path       = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.auth_section = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.auth_type = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.cafile   = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.certfile = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.collect_timing = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.insecure = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.keyfile  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.split_loggers = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] barbican_service_user.timeout  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.approle_role_id          = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.approle_secret_id        = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.kv_mountpoint            = secret {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.kv_path                  = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.kv_version               = 2 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.namespace                = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.root_token_id            = **** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.ssl_ca_crt_file          = None {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.timeout                  = 60.0 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.use_ssl                  = False {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:37:05 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] ******************************************************************************** {{(pid=82685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 29 04:37:05 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:05 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:05 devstack sudo[83045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:05 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:06 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:06 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.658s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:06 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:37:06 devstack cinder-volume[82855]: INFO cinder.brick.local_dev.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 29 04:37:06 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:06 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:06 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:06 devstack sudo[83272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:06 devstack sudo[83272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:07 devstack sudo[83272]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:07 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:07 devstack cinder-volume[82855]: DEBUG cinder.brick.local_dev.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82855) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 29 04:37:07 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:07 devstack sudo[83425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:07 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:08 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:08 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.129s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:08 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:08 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:08 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:08 devstack sudo[83630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:08 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:09 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:09 devstack sudo[83639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 29 04:37:09 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:09 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.744s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:09 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:09 devstack sudo[83649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:09 devstack sudo[83649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:10 devstack sudo[83649]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:10 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.829s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:10 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:10 devstack sudo[83654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:10 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:11 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:11 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:11 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:11 devstack sudo[83658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:11 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:12 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:12 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.906s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:12 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:12 devstack sudo[83664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:12 devstack sudo[83664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:13 devstack sudo[83664]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.726s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:13 devstack sudo[83673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:13 devstack sudo[83673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:13 devstack sudo[83673]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:13 devstack cinder-volume[82855]: INFO cinder.volume.drivers.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:13 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:13 devstack sudo[83686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:13 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:14 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:14 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.770s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:14 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:37:14 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:14 devstack sudo[83800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:14 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:15 devstack cinder-volume[82685]: DEBUG dbcounter [-] [82685] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:37:15 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:15 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:15 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:15 devstack sudo[83941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:15 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:15 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:15 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:15 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:15 devstack sudo[83944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:15 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:16 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:16 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:16 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:16 devstack sudo[83947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:16 devstack sudo[83947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:17 devstack sudo[83947]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:17 devstack cinder-volume[82855]: INFO cinder.volume.driver [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Driver hasn't implemented _init_vendor_properties()
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG cinder.volume.driver [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82855) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG oslo_db.sqlalchemy.engines [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writer thread running {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG cinder.db.api [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Building query based on filter {{(pid=82855) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG cinder.image.image_utils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82855) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 29 04:37:17 devstack cinder-volume[82855]: INFO cinder.keymgr.migration [None req-d8e25b09-9e44-4eb0-b81c-1bf4dccbff7e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:37:17 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:17 devstack sudo[83955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:17 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:18 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:18 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:18 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:18 devstack sudo[83959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:18 devstack sudo[83959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:18 devstack sudo[83959]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:18 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:18 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:18 devstack sudo[83962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:18 devstack sudo[83962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:19 devstack sudo[83962]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:19 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:19 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:19 devstack sudo[83966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:19 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:20 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG cinder.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Notifying Schedulers of capabilities ... {{(pid=82855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:37:20 devstack cinder-volume[82855]: INFO cinder.volume.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Driver initialization completed successfully.
Jun 29 04:37:20 devstack cinder-volume[82855]: INFO cinder.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Initiating service 2 cleanup
Jun 29 04:37:20 devstack cinder-volume[82855]: INFO cinder.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Service 2 cleanup completed.
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG cinder.service [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Creating RPC server for service cinder-volume {{(pid=82855) start /opt/stack/cinder/cinder/service.py:231}}
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG cinder.service [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82855) start /opt/stack/cinder/cinder/service.py:237}}
Jun 29 04:37:20 devstack cinder-volume[82855]: INFO cinder.volume.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:20 devstack sudo[83970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:37:20 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:20 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:20 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:20 devstack sudo[83976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:20 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:21 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:21 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:21 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:21 devstack sudo[84033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:37:21 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:22 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:22 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:22 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:37:22 devstack sudo[84036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:37:22 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:37:22 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root
Jun 29 04:37:22 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:37:22 devstack cinder-volume[82855]: INFO cinder.volume.manager [None req-4326136d-5b77-4543-bdc3-9ac8e12cfac0 None None] Driver post RPC initialization completed successfully.
Jun 29 04:37:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:37:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:38:00 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager._thread_info {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:38:00 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread count: 6 {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:38:00 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread info: [<_MainThread(MainThread, started 131531248038016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131531145865984)>, <Thread(Thread-3 (stat_writer), started daemon 131531135115648)>, <Thread(Rabbit-heartbeat, started daemon 131531135891584)>, <Thread(Thread-5 (_runner), started daemon 131531135118016)>, <Thread(Thread-7 (_runner), started daemon 131531134079232)>] {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:39:00 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:39:00 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:39:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:39:00 devstack sudo[88878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:39:00 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:39:01 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root
Jun 29 04:39:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:39:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:39:01 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:39:01 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:39:02 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Jun 29 04:39:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:39:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:39:02 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:39:02 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:39:02 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Jun 29 04:39:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:39:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:39:02 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:39:02 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:39:03 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Jun 29 04:39:03 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:39:03 devstack cinder-volume[82855]: DEBUG cinder.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Notifying Schedulers of capabilities ... {{(pid=82855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:39:03 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager._thread_info {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:39:03 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread count: 6 {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:39:03 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread info: [<_MainThread(MainThread, started 131531248038016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131531145865984)>, <Thread(Thread-3 (stat_writer), started daemon 131531135115648)>, <Thread(Rabbit-heartbeat, started daemon 131531135891584)>, <Thread(Thread-5 (_runner), started daemon 131531135118016)>, <Thread(Thread-7 (_runner), started daemon 131531134079232)>] {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:39:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:SELECT=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:39:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:UPDATE=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:40:00 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:40:00 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:40:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:40:00 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:40:00 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:40:01 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Jun 29 04:40:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:40:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:40:01 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:40:01 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:40:02 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Jun 29 04:40:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:40:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:40:02 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:40:02 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:40:02 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Jun 29 04:40:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:40:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:40:02 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:40:02 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:40:03 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Jun 29 04:40:03 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:40:03 devstack cinder-volume[82855]: DEBUG cinder.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Notifying Schedulers of capabilities ... {{(pid=82855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:40:03 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager._thread_info {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:40:03 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread count: 6 {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:40:03 devstack cinder-volume[82855]: DEBUG cinder.volume.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] thread info: [<_MainThread(MainThread, started 131531248038016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131531145865984)>, <Thread(Thread-3 (stat_writer), started daemon 131531135115648)>, <Thread(Rabbit-heartbeat, started daemon 131531135891584)>, <Thread(Thread-5 (_runner), started daemon 131531135118016)>, <Thread(Thread-7 (_runner), started daemon 131531134079232)>] {{(pid=82855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:41:00 devstack cinder-volume[82855]: DEBUG oslo_service.periodic_task [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:41:00 devstack cinder-volume[82855]: DEBUG cinder.volume.drivers.lvm [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Updating volume stats {{(pid=82855) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 29 04:41:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:41:00 devstack sudo[91589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 29 04:41:00 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:41:01 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root
Jun 29 04:41:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:41:01 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:41:01 devstack sudo[91630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:41:01 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:41:02 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root
Jun 29 04:41:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:41:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:41:02 devstack sudo[91638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 29 04:41:02 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:41:02 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root
Jun 29 04:41:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:41:02 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:41:02 devstack sudo[91642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 29 04:41:02 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:41:03 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root
Jun 29 04:41:03 devstack cinder-volume[82855]: DEBUG oslo_concurrency.processutils [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=82855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:41:03 devstack cinder-volume[82855]: DEBUG cinder.manager [None req-12d35837-26c6-468e-b83a-148ca251e948 None None] Notifying Schedulers of capabilities ... {{(pid=82855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:41:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:SELECT=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:41:32 devstack cinder-volume[82855]: DEBUG dbcounter [-] [82855] Writing DB stats cinder:UPDATE=1 {{(pid=82855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:41:58 devstack cinder-volume[82685]: INFO oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Caught SIGTERM, stopping children
Jun 29 04:41:58 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Acquiring lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:41:58 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Acquired lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:41:58 devstack cinder-volume[82685]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Releasing lock "singleton_lock" {{(pid=82685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:41:58 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Stop services. {{(pid=82685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 29 04:41:58 devstack cinder-volume[82685]: DEBUG oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Killing children. {{(pid=82685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 29 04:41:58 devstack cinder-volume[82685]: INFO oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Waiting on 1 children to exit
Jun 29 04:42:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Acquiring lock "singleton_lock" {{(pid=82855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:42:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Acquired lock "singleton_lock" {{(pid=82855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:42:00 devstack cinder-volume[82855]: DEBUG oslo_concurrency.lockutils [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Releasing lock "singleton_lock" {{(pid=82855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:42:00 devstack cinder-volume[82855]: WARNING amqp [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 29 04:42:00 devstack cinder-volume[82855]: WARNING amqp [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 29 04:42:00 devstack cinder-volume[82685]: INFO oslo_service.backend._eventlet.service [None req-8f1bf5af-3825-4376-823c-1eb9a3eeedd5 None None] Child 82855 exited with status 0
Jun 29 04:42:00 devstack cinder-volume[92937]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 29 04:42:00 devstack cinder-volume[92937]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 29 04:42:00 devstack cinder-volume[92937]: we strongly recommend against using it for new projects.
Jun 29 04:42:00 devstack cinder-volume[92937]: If you are already using Eventlet, we recommend migrating to a different
Jun 29 04:42:00 devstack cinder-volume[92937]: framework.  For more detail see
Jun 29 04:42:00 devstack cinder-volume[92937]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 29 04:42:00 devstack cinder-volume[92937]:   import eventlet  # noqa
Jun 29 04:42:02 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:42:02 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:42:02 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO dbcounter [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Registered counter for database cinder
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG dbcounter [-] [92937] Writer thread running {{(pid=92937) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO cinder.rpc [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO cinder.rpc [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Determined volume DB was empty at startup.
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG cinder.volume.manager [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92937) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 29 04:42:03 devstack cinder-volume[92937]: WARNING stevedore.named [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 29 04:42:03 devstack cinder-volume[92937]: WARNING castellan.key_manager [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:42:03 devstack cinder-volume[92937]: WARNING cinder.keymgr.conf_key_mgr [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO cinder.volume.manager [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_db.sqlalchemy.engines [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92937) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:03 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Starting 1 workers
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Started child 93152 {{(pid=92937) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Full set of CONF: {{(pid=92937) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] ******************************************************************************** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Configuration options gathered from: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] ================================================================================ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] allow_availability_zone_fallback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] allow_compression_on_image_upload = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] allowed_direct_url_schemes     = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] api_rate_limit                 = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] auth_strategy                  = keystone {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_availability_zone      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_host                   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_name                   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[93152]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_stats_polling_interval = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backup_api_class               = cinder.backup.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backup_name_template           = backup-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backup_use_same_host           = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backup_use_temp_snapshot       = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] chap_password                  = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:03 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] chap_username                  =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_internal_tenant_project_id = 4aea1c721e124dffbe6bbebff2c194f9 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_internal_tenant_user_id = ecc3bec222a844df8741ce8091d3e634 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cluster                        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] compression_format             = gzip {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] compute_api_class              = cinder.compute.nova.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] config_dir                     = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] config_source                  = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] control_exchange               = openstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] debug                          = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] default_availability_zone      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] default_group_type             = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] default_volume_type            = QuobyteHD {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] disk_geometry                  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_client_cert             = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_client_cert_key         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_data_namespace          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_ssl_cert_path           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_ssl_cert_verify         = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] driver_use_ssl                 = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] enable_new_services            = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] enable_unsupported_driver      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] enabled_backends               = ['QuobyteHD'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] enforce_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] filter_function                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_api_insecure            = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_api_servers             = ['http://192.168.122.111/image'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_api_ssl_compression     = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_ca_certificates_file    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_catalog_info            = image:glance:publicURL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_certfile                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_keyfile                 = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_num_retries             = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance_request_timeout         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] goodness_function              = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] graceful_shutdown_timeout      = 5 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] group_api_class                = cinder.group.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] host                           = devstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_compress_on_upload       = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_conversion_address_space_limit = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_conversion_cpu_limit     = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_conversion_disable       = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_upload_use_cinder_backend = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_upload_use_internal_tenant = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_volume_cache_enabled     = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_volume_cache_max_count   = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] image_volume_cache_max_size_gb = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] init_host_max_objects_retrieval = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] instance_format                = [instance: %(uuid)s]  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iscsi_target_flags             =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iscsi_write_cache              = on {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iser_helper                    = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iser_ip_address                = 192.168.122.111 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iser_port                      = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[93152]: INFO cinder.volume.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.remotefs [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93152) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_color                      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_config_append              = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_dir                        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_file                       = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_options                    = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_rotate_interval            = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_rotate_interval_type       = days {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] log_rotation_type              = none {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] max_age                        = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] max_logfile_count              = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] max_logfile_size_mb            = 200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] max_over_subscription_ratio    = 20.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] message_reap_interval          = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] message_ttl                    = 2592000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] migration_create_volume_timeout_secs = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] monkey_patch                   = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] monkey_patch_modules           = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] my_ip                          = 192.168.122.111 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] no_snapshot_gb_quota           = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] num_iser_scan_tries            = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] num_shell_tries                = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] num_volume_device_scan_tries   = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] nvmeof_conn_info_version       = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] nvmet_ns_id                    = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] nvmet_port_id                  = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_max_limit                = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_ext_list          = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_listen_port       = 8776 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_use_ssl           = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] osapi_volume_workers           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] per_volume_size_limit          = -1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] periodic_fuzzy_delay           = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] periodic_interval              = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] public_endpoint                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] publish_errors                 = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_backup_gigabytes         = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_backups                  = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_gigabytes                = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_groups                   = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_snapshots                = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] quota_volumes                  = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] rate_limit_burst               = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] rate_limit_except_level        = CRITICAL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] rate_limit_interval            = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] reinit_driver_count            = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] replication_device             = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] report_discard_supported       = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] report_interval                = 120 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] reservation_clean_interval     = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] reservation_expire             = 86400 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] reserved_image_namespaces      = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] reserved_percentage            = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] rpc_response_timeout           = 120 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] run_external_periodic_tasks    = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] scst_target_driver             = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] scst_target_iqn_name           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_down_time              = 720 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] shell_completion               = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] snapshot_name_template         = snapshot-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] split_loggers                  = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] state_path                     = /opt/stack/data/cinder {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] storage_availability_zone      = nova {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] storage_protocol               = iSCSI {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] syslog_log_facility            = LOG_USER {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_helper                  = lioadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_ip_address              = 192.168.122.111 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_port                    = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_protocol                = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] target_secondary_ip_addresses  = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] trace_flags                    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] transport_url                  = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] until_refresh                  = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_chap_auth                  = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_default_quota_class        = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_journal                    = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_json                       = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_multipath_for_image_xfer   = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_stderr                     = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] use_syslog                     = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] verify_glance_signatures       = enabled {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_api_class               = cinder.volume.api.API {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_backend_name            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_clear                   = zero {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_clear_ionice            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_clear_size              = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_copy_bps_limit          = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_dd_blocksize            = 1M {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_name_template           = volume-%s {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_service_inithost_offload = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volume_usage_audit_period      = month {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] zoning_mode                    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_concurrency.disable_process_locking = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.auth_type   = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.auth_version = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.cache       = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.certfile    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.include_service_catalog = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.insecure    = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.interface   = public {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.keyfile     = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_password =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcache_username =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.region_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.service_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.backend                  = dogpile.cache.null {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.backend_argument         = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.backend_expiration_time  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.config_prefix            = cache.oslo {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.debug_cache_backend      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.enable_retry_client      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.enable_socket_keepalive  = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.enabled                  = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.expiration_time          = 600 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.hashclient_retry_attempts = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_dead_retry      = 300 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_pool_maxsize    = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_sasl_enabled    = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.password                 = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.proxies                  = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93152) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 29 04:42:04 devstack cinder-volume[93152]: WARNING cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 29 04:42:04 devstack cinder-volume[93152]: WARNING cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.redis_db                 = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.redis_server             = localhost:6379 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.retry_attempts           = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.retry_delay              = 0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.socket_keepalive_count   = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.socket_keepalive_idle    = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.socket_keepalive_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.socket_timeout           = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.tls_allowed_ciphers      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.tls_cafile               = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.tls_certfile             = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.tls_enabled              = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.tls_keyfile              = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Running cmd (subprocess): mount.quobyte {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cache.username                 = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] coordination.backend_url       = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.asyncio_connection    = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.asyncio_slave_connection = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.backend               = sqlalchemy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.connection            = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.connection_debug      = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.connection_parameters =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.connection_recycle_time = 3600 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.connection_trace      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.db_inc_retry_interval = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.db_max_retries        = 20 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.db_max_retry_interval = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.db_retry_interval     = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.max_overflow          = 50 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.max_pool_size         = 5 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.max_retries           = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.mysql_wsrep_sync_wait = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.pool_timeout          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.retry_interval        = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.slave_connection      = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.sqlite_synchronous    = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.synchronous_reader    = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] database.use_db_reconnect      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.connection_string     = messaging:// {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.enabled               = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.es_doc_type           = notification {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.es_scroll_size        = 10000 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.es_scroll_time        = 2m {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.filter_error_trace    = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.hmac_keys             = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.sentinel_service_name = mymaster {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.socket_timeout        = 0.1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.trace_requests        = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler.trace_sqlalchemy      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler_jaeger.process_tags   = {} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler_jaeger.service_name_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] profiler_otlp.service_name_prefix = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.enforce_new_defaults = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: WARNING oslo_config.cfg [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.enforce_scope      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.policy_default_rule = default {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.policy_file        = policy.yaml {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.group          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.helper_command = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] privsep_osbrick.user           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.group         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.helper_command = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] cinder_sys_admin.user          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.auth_section      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.auth_type         = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.cafile            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.certfile          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.collect_timing    = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.insecure          = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.keyfile           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.send_service_user_token = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.split_loggers     = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] service_user.timeout           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.auth_section            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.auth_type               = password {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.certfile                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.collect_timing          = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.insecure                = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.keyfile                 = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.region_name             = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.split_loggers           = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] glance.timeout                 = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.backend_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.chap_password = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.chap_username =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.disk_geometry = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_client_cert = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_client_cert_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_data_namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.driver_use_ssl = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.extra_capabilities = {} {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.filter_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.goodness_function = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iscsi_target_flags =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iscsi_write_cache = on {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iser_helper   = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iser_port     = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_host      =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_login     = admin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_mount_options = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_password  = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_private_key =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_share_path =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.num_shell_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.quobyte_volume_url = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.replication_device = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.report_discard_supported = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.reserved_percentage = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_helper = tgtadm {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_port   = 3260 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_protocol = iscsi {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.trace_flags   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.unique_fqdn_network = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.use_chap_auth = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_backend_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_clear  = zero {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_clear_ionice = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_clear_size = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_reports.file_event_handler = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_reports.log_dir           = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.backend_availability_zone = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.backend_host         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.chap_password        = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.chap_username        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.chiscsi_conf         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.disk_geometry        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_client_cert   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_data_namespace = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.driver_use_ssl       = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.extra_capabilities   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.filter_function      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.goodness_function    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iser_helper          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iser_ip_address      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iser_port            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.iser_target_prefix   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_host             = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_login            = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_mount_options    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_password         = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_private_key      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_share_path       = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_ssh_port         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.num_shell_tries      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.nvmet_port_id        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.replication_device   = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.report_discard_supported = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.reserved_percentage  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.scst_target_driver   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.storage_protocol     = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_helper        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_ip_address    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_port          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_prefix        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_protocol      = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.trace_flags          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.use_chap_auth        = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_clear         = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_clear_size    = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] QuobyteHD.volumes_dir          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl      = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_notifications.driver = [] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_notifications.retry = -1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] key_manager.fixed_key          = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.barbican_api_version  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.barbican_endpoint     = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.barbican_endpoint_type = public {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.barbican_region_name  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.cafile                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.certfile              = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.collect_timing        = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.insecure              = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.keyfile               = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.number_of_retries     = 60 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.retry_delay           = 1 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.send_service_user_token = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.split_loggers         = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.timeout               = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.verify_ssl            = True {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican.verify_ssl_path       = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.auth_section = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.auth_type = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.cafile   = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.certfile = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.collect_timing = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.insecure = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.keyfile  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.split_loggers = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] barbican_service_user.timeout  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.approle_role_id          = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.approle_secret_id        = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.kv_mountpoint            = secret {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.kv_path                  = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.kv_version               = 2 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.namespace                = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.root_token_id            = **** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.ssl_ca_crt_file          = None {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.timeout                  = 60.0 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.use_ssl                  = False {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:04 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] ******************************************************************************** {{(pid=92937) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] CMD "mount.quobyte" returned: 1 in 0.152s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:04 devstack cinder-volume[93152]: INFO cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce ...
Jun 29 04:42:04 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 -c /etc/quobyte/client-cinder.cfg {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:04 devstack sudo[93158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 -c /etc/quobyte/client-cinder.cfg
Jun 29 04:42:04 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:05 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.781s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:05 devstack cinder-volume[93152]: INFO cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce succeeded
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.796s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:05 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:05 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:05 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.642s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:05 devstack cinder-volume[93152]: INFO cinder.volume.driver [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Driver hasn't implemented _init_vendor_properties()
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.volume.driver [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93152) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_db.sqlalchemy.engines [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG dbcounter [-] [93152] Writer thread running {{(pid=93152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.db.api [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Building query based on filter {{(pid=93152) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.image.image_utils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93152) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 29 04:42:05 devstack cinder-volume[93152]: INFO cinder.keymgr.migration [None req-4f8342ec-18fe-4bd3-86bf-3735d46adaf0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:05 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:05 devstack sudo[93231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:05 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:06 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.643s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG cinder.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Notifying Schedulers of capabilities ... {{(pid=93152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:42:06 devstack cinder-volume[93152]: INFO cinder.volume.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Driver initialization completed successfully.
Jun 29 04:42:06 devstack cinder-volume[93152]: INFO cinder.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Initiating service 3 cleanup
Jun 29 04:42:06 devstack cinder-volume[93152]: INFO cinder.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Service 3 cleanup completed.
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG cinder.service [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Creating RPC server for service cinder-volume {{(pid=93152) start /opt/stack/cinder/cinder/service.py:231}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG cinder.service [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93152) start /opt/stack/cinder/cinder/service.py:237}}
Jun 29 04:42:06 devstack cinder-volume[93152]: INFO cinder.volume.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:06 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:06 devstack sudo[93238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:06 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:07 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:07 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.680s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:07 devstack cinder-volume[93152]: INFO cinder.volume.manager [None req-d20f6f61-7946-4114-afd2-4d21bb26f330 None None] Driver post RPC initialization completed successfully.
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG cinder.volume.drivers.quobyte [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:11 devstack sudo[93352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:11 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:11 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG oslo_concurrency.processutils [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.603s {{(pid=93152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:11 devstack cinder-volume[93152]: DEBUG cinder.manager [None req-7bca03f4-a0c5-49dd-9b56-43a767632dc7 None None] Notifying Schedulers of capabilities ... {{(pid=93152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:42:13 devstack cinder-volume[92937]: DEBUG dbcounter [-] [92937] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92937) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:42:14 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Caught SIGTERM, stopping children
Jun 29 04:42:14 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Acquiring lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:42:14 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Acquired lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:42:14 devstack cinder-volume[92937]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Releasing lock "singleton_lock" {{(pid=92937) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:42:14 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Stop services. {{(pid=92937) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 29 04:42:14 devstack cinder-volume[92937]: DEBUG oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Killing children. {{(pid=92937) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 29 04:42:14 devstack cinder-volume[92937]: INFO oslo_service.backend._eventlet.service [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Waiting on 1 children to exit
Jun 29 04:42:16 devstack cinder-volume[93152]: DEBUG dbcounter [-] [93152] Writing DB stats cinder:SELECT=3 {{(pid=93152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:42:17 devstack cinder-volume[93152]: DEBUG dbcounter [-] [93152] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:42:19 devstack cinder-volume[93152]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 29 04:42:19 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Acquiring lock "singleton_lock" {{(pid=93152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:42:19 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Acquired lock "singleton_lock" {{(pid=93152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:42:19 devstack cinder-volume[93152]: DEBUG oslo_concurrency.lockutils [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Releasing lock "singleton_lock" {{(pid=93152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:42:19 devstack cinder-volume[93152]: WARNING amqp [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 29 04:42:20 devstack cinder-volume[93152]: WARNING amqp [None req-f9978e0d-0c27-4efe-ab74-051e8f926383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 29 04:42:20 devstack cinder-volume[93441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 29 04:42:20 devstack cinder-volume[93441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 29 04:42:20 devstack cinder-volume[93441]: we strongly recommend against using it for new projects.
Jun 29 04:42:20 devstack cinder-volume[93441]: If you are already using Eventlet, we recommend migrating to a different
Jun 29 04:42:20 devstack cinder-volume[93441]: framework.  For more detail see
Jun 29 04:42:20 devstack cinder-volume[93441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 29 04:42:20 devstack cinder-volume[93441]:   import eventlet  # noqa
Jun 29 04:42:22 devstack cinder-volume[93441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 29 04:42:22 devstack cinder-volume[93441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 29 04:42:22 devstack cinder-volume[93441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO dbcounter [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Registered counter for database cinder
Jun 29 04:42:23 devstack cinder-volume[93441]: DEBUG oslo_db.sqlalchemy.engines [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:23 devstack cinder-volume[93441]: DEBUG dbcounter [-] [93441] Writer thread running {{(pid=93441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO cinder.rpc [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO cinder.rpc [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 29 04:42:23 devstack cinder-volume[93441]: DEBUG oslo_db.sqlalchemy.engines [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO cinder.volume.manager [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Determined volume DB was empty at startup.
Jun 29 04:42:23 devstack cinder-volume[93441]: DEBUG cinder.volume.manager [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93441) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 29 04:42:23 devstack cinder-volume[93441]: WARNING stevedore.named [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 29 04:42:23 devstack cinder-volume[93441]: WARNING castellan.key_manager [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:42:23 devstack cinder-volume[93441]: WARNING cinder.keymgr.conf_key_mgr [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO cinder.volume.manager [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 29 04:42:23 devstack cinder-volume[93441]: DEBUG oslo_db.sqlalchemy.engines [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:23 devstack cinder-volume[93441]: INFO oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Starting 1 workers
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Started child 93723 {{(pid=93441) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Full set of CONF: {{(pid=93441) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] ******************************************************************************** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Configuration options gathered from: {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] ================================================================================ {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] allow_availability_zone_fallback = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] allow_compression_on_image_upload = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93723]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] allowed_direct_url_schemes     = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] api_rate_limit                 = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] auth_strategy                  = keystone {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_availability_zone      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_host                   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_name                   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_stats_polling_interval = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backup_api_class               = cinder.backup.api.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backup_name_template           = backup-%s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backup_use_same_host           = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backup_use_temp_snapshot       = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] chap_password                  = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] chap_username                  =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_internal_tenant_project_id = 4aea1c721e124dffbe6bbebff2c194f9 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_internal_tenant_user_id = ecc3bec222a844df8741ce8091d3e634 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cluster                        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] compression_format             = gzip {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] compute_api_class              = cinder.compute.nova.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] config_dir                     = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] config_source                  = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] control_exchange               = openstack {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] debug                          = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] default_availability_zone      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] default_group_type             = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] default_volume_type            = QuobyteHD {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] disk_geometry                  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_client_cert             = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_client_cert_key         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_data_namespace          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_ssl_cert_path           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_ssl_cert_verify         = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] driver_use_ssl                 = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] enable_new_services            = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] enable_unsupported_driver      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] enabled_backends               = ['QuobyteHD'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] enforce_multipath_for_image_xfer = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] filter_function                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_api_insecure            = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_api_servers             = ['http://192.168.122.111/image'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_api_ssl_compression     = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_ca_certificates_file    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_catalog_info            = image:glance:publicURL {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_certfile                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_keyfile                 = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_num_retries             = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance_request_timeout         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] goodness_function              = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] graceful_shutdown_timeout      = 5 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] group_api_class                = cinder.group.api.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] host                           = devstack {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_compress_on_upload       = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_conversion_address_space_limit = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_conversion_cpu_limit     = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_conversion_disable       = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_upload_use_cinder_backend = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_upload_use_internal_tenant = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_volume_cache_enabled     = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_volume_cache_max_count   = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] image_volume_cache_max_size_gb = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] init_host_max_objects_retrieval = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] instance_format                = [instance: %(uuid)s]  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iscsi_target_flags             =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iscsi_write_cache              = on {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iser_helper                    = tgtadm {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iser_ip_address                = 192.168.122.111 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iser_port                      = 3260 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_color                      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_config_append              = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_dir                        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_file                       = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_options                    = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_rotate_interval            = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_rotate_interval_type       = days {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] log_rotation_type              = none {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] max_age                        = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93723) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] max_logfile_count              = 30 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] max_logfile_size_mb            = 200 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] max_over_subscription_ratio    = 20.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] message_reap_interval          = 86400 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] message_ttl                    = 2592000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] migration_create_volume_timeout_secs = 300 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] monkey_patch                   = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] monkey_patch_modules           = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] my_ip                          = 192.168.122.111 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] no_snapshot_gb_quota           = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] num_iser_scan_tries            = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] num_shell_tries                = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] num_volume_device_scan_tries   = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] nvmeof_conn_info_version       = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] nvmet_ns_id                    = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] nvmet_port_id                  = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_max_limit                = 1000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_ext_list          = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_listen_port       = 8776 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_use_ssl           = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] osapi_volume_workers           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] per_volume_size_limit          = -1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] periodic_fuzzy_delay           = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] periodic_interval              = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] public_endpoint                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] publish_errors                 = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_backup_gigabytes         = 1000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_backups                  = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_gigabytes                = 1000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_groups                   = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_snapshots                = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] quota_volumes                  = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] rate_limit_burst               = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] rate_limit_except_level        = CRITICAL {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] rate_limit_interval            = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] reinit_driver_count            = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] replication_device             = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] report_discard_supported       = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] report_interval                = 120 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] reservation_clean_interval     = 86400 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] reservation_expire             = 86400 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] reserved_image_namespaces      = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] reserved_percentage            = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] rpc_response_timeout           = 120 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] run_external_periodic_tasks    = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] scst_target_driver             = iscsi {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] scst_target_iqn_name           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_down_time              = 720 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] shell_completion               = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] snapshot_name_template         = snapshot-%s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] split_loggers                  = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] state_path                     = /opt/stack/data/cinder {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] storage_availability_zone      = nova {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] storage_protocol               = iSCSI {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] syslog_log_facility            = LOG_USER {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_helper                  = lioadm {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_ip_address              = 192.168.122.111 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_port                    = 3260 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_protocol                = iscsi {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] target_secondary_ip_addresses  = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] trace_flags                    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] transport_url                  = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] until_refresh                  = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_chap_auth                  = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_default_quota_class        = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_journal                    = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_json                       = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_multipath_for_image_xfer   = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_stderr                     = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] use_syslog                     = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] verify_glance_signatures       = enabled {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_api_class               = cinder.volume.api.API {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_backend_name            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_clear                   = zero {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_clear_ionice            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_clear_size              = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_copy_bps_limit          = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_dd_blocksize            = 1M {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_name_template           = volume-%s {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_service_inithost_offload = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volume_usage_audit_period      = month {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] zoning_mode                    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_concurrency.disable_process_locking = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.auth_section = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.auth_type   = password {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.auth_version = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.cache       = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.certfile    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.include_service_catalog = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.insecure    = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.interface   = public {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.keyfile     = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_password =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcache_username =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.region_name = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.service_type = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.backend                  = dogpile.cache.null {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.backend_argument         = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.backend_expiration_time  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.config_prefix            = cache.oslo {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.debug_cache_backend      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.enable_retry_client      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.enable_socket_keepalive  = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.enabled                  = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.expiration_time          = 600 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.hashclient_retry_attempts = 2 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_dead_retry      = 300 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_pool_maxsize    = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_sasl_enabled    = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.password                 = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.proxies                  = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.redis_db                 = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.redis_server             = localhost:6379 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.retry_attempts           = 2 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.retry_delay              = 0.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.socket_keepalive_count   = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.socket_keepalive_idle    = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.socket_keepalive_interval = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.socket_timeout           = 1.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.tls_allowed_ciphers      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.tls_cafile               = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.tls_certfile             = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.tls_enabled              = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.tls_keyfile              = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cache.username                 = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] coordination.backend_url       = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.asyncio_connection    = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.asyncio_slave_connection = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.backend               = sqlalchemy {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.connection            = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.connection_debug      = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.connection_parameters =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.connection_recycle_time = 3600 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.connection_trace      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.db_inc_retry_interval = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.db_max_retries        = 20 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.db_max_retry_interval = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.db_retry_interval     = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.max_overflow          = 50 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.max_pool_size         = 5 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.max_retries           = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.mysql_wsrep_sync_wait = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.pool_timeout          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.retry_interval        = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.slave_connection      = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.sqlite_synchronous    = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.synchronous_reader    = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] database.use_db_reconnect      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93723) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 29 04:42:24 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.connection_string     = messaging:// {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.enabled               = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.es_doc_type           = notification {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.es_scroll_size        = 10000 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Running cmd (subprocess): mount.quobyte {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.es_scroll_time        = 2m {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.filter_error_trace    = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.hmac_keys             = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.sentinel_service_name = mymaster {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.socket_timeout        = 0.1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.trace_requests        = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler.trace_sqlalchemy      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler_jaeger.process_tags   = {} {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler_jaeger.service_name_prefix = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] profiler_otlp.service_name_prefix = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.enforce_new_defaults = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: WARNING oslo_config.cfg [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.enforce_scope      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.policy_default_rule = default {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.policy_file        = policy.yaml {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.group          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.helper_command = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] privsep_osbrick.user           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.group         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.helper_command = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] cinder_sys_admin.user          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.auth_section      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.auth_type         = password {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.cafile            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.certfile          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.collect_timing    = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.insecure          = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.keyfile           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.send_service_user_token = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.split_loggers     = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] service_user.timeout           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.auth_section            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.auth_type               = password {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.certfile                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.collect_timing          = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.insecure                = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.keyfile                 = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.region_name             = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.split_loggers           = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] glance.timeout                 = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.backend_availability_zone = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.chap_password = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.chap_username =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.disk_geometry = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_client_cert = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_client_cert_key = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_data_namespace = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.driver_use_ssl = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.extra_capabilities = {} {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.filter_function = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.goodness_function = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iscsi_target_flags =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iscsi_write_cache = on {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iser_helper   = tgtadm {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iser_port     = 3260 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_host      =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_login     = admin {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_mount_options = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_password  = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_private_key =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_share_path =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.num_shell_tries = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.quobyte_volume_url = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.replication_device = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.report_discard_supported = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.reserved_percentage = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_helper = tgtadm {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_port   = 3260 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_protocol = iscsi {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.trace_flags   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.unique_fqdn_network = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.use_chap_auth = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_backend_name = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_clear  = zero {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_clear_ionice = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_clear_size = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_reports.file_event_handler = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_reports.log_dir           = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.backend_availability_zone = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.backend_host         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.chap_password        = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.chap_username        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.chiscsi_conf         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.disk_geometry        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_client_cert   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_data_namespace = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.driver_use_ssl       = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.extra_capabilities   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.filter_function      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.goodness_function    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iser_helper          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iser_ip_address      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iser_port            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack quobyte-client[93724]: Reading configuration file: /etc/quobyte/client.cfg
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.iser_target_prefix   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_host             = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_login            = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack quobyte-client[93724]: Invalid parameters found, error: missing mount point.
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_mount_options    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_password         = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_private_key      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_share_path       = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack quobyte-client[93724]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_ssh_port         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.num_shell_tries      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack quobyte-client[93724]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.nvmet_port_id        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.replication_device   = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.report_discard_supported = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.reserved_percentage  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.scst_target_driver   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.storage_protocol     = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_helper        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_ip_address    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_port          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_prefix        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_protocol      = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.trace_flags          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.use_chap_auth        = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_clear         = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_clear_size    = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] QuobyteHD.volumes_dir          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl      = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_notifications.driver = [] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_notifications.retry = -1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] key_manager.fixed_key          = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.barbican_api_version  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.barbican_endpoint     = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.barbican_endpoint_type = public {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.barbican_region_name  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.cafile                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.certfile              = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.collect_timing        = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.insecure              = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.keyfile               = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.number_of_retries     = 60 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.retry_delay           = 1 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.send_service_user_token = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.split_loggers         = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.timeout               = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.verify_ssl            = True {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican.verify_ssl_path       = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.auth_section = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.auth_type = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.cafile   = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.certfile = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.collect_timing = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.insecure = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.keyfile  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.split_loggers = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] barbican_service_user.timeout  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.approle_role_id          = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.approle_secret_id        = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.kv_mountpoint            = secret {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.kv_path                  = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.kv_version               = 2 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.namespace                = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.root_token_id            = **** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.ssl_ca_crt_file          = None {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.timeout                  = 60.0 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.use_ssl                  = False {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 29 04:42:24 devstack cinder-volume[93441]: DEBUG oslo_service.backend._eventlet.service [None req-ea580be1-2d8d-4efc-8148-0f83d08f6434 None None] ******************************************************************************** {{(pid=93441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 29 04:42:24 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:24 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:24 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.639s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:24 devstack cinder-volume[93723]: INFO cinder.volume.driver [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Driver hasn't implemented _init_vendor_properties()
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.driver [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93723) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_db.sqlalchemy.engines [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93723) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writer thread running {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.db.api [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Building query based on filter {{(pid=93723) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93723) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:25 devstack cinder-volume[93723]: INFO cinder.keymgr.migration [None req-3f2872b2-5a5d-40f9-ab97-7a16ce4ef9df None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 29 04:42:25 devstack sudo[93791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:25 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:25 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.625s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:42:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Driver initialization completed successfully.
Jun 29 04:42:25 devstack cinder-volume[93723]: INFO cinder.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Initiating service 3 cleanup
Jun 29 04:42:25 devstack cinder-volume[93723]: INFO cinder.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Service 3 cleanup completed.
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG cinder.service [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Creating RPC server for service cinder-volume {{(pid=93723) start /opt/stack/cinder/cinder/service.py:231}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG cinder.service [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93723) start /opt/stack/cinder/cinder/service.py:237}}
Jun 29 04:42:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:42:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:42:25 devstack sudo[93810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:42:25 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:42:26 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root
Jun 29 04:42:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:42:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-45b58965-9e62-463b-bce7-a33f807bddcd None None] Driver post RPC initialization completed successfully.
Jun 29 04:42:33 devstack cinder-volume[93441]: DEBUG dbcounter [-] [93441] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:42:35 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:42:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:43:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:43:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 6 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:43:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Flow 'volume_create_manager' (cf194d10-2e13-4c9d-8e6b-259dbebef253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e909cfdf-025c-4e28-8ce5-f7cfc5b46dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e909cfdf-025c-4e28-8ce5-f7cfc5b46dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2068417798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2476b0-4f96-4f77-83a8-2da5ca9ef798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946cdcf9358b425d80eaf2fff6e21b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:43:22Z,use_quota=True,user_id='cedb6b19e5194b1f9ef525f4e13a908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4408c03-a537-418d-9474-cbc2d7d966cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4408c03-a537-418d-9474-cbc2d7d966cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ee6404-00d1-436d-a25f-c22c81816fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ee6404-00d1-436d-a25f-c22c81816fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2476b0-4f96-4f77-83a8-2da5ca9ef798', 'volume_name': 'volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4265c61-bc34-43d0-a6d7-8b9f25fe434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4265c61-bc34-43d0-a6d7-8b9f25fe434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032aa73f-bb3b-4a36-8c8c-88f33810dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:22 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Volume 7f2476b0-4f96-4f77-83a8-2da5ca9ef798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798', 'volume_size': 1}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2068417798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2476b0-4f96-4f77-83a8-2da5ca9ef798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946cdcf9358b425d80eaf2fff6e21b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:43:22Z,use_quota=True,user_id='cedb6b19e5194b1f9ef525f4e13a908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Creating volume 7f2476b0-4f96-4f77-83a8-2da5ca9ef798 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:43:22 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:43:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:43:22 devstack sudo[94081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 1073741824
Jun 29 04:43:22 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:43:24 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 1073741824" returned: 0 in 1.447s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:43:24 devstack sudo[94421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798
Jun 29 04:43:24 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:43:24 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" returned: 0 in 0.712s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032aa73f-bb3b-4a36-8c8c-88f33810dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af3c14a-406b-40df-be5a-bfa4cc6a278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:43:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Volume volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 (7f2476b0-4f96-4f77-83a8-2da5ca9ef798): created successfully
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af3c14a-406b-40df-be5a-bfa4cc6a278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:43:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Flow 'volume_create_manager' (cf194d10-2e13-4c9d-8e6b-259dbebef253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:43:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bc0953ae-1ab1-40a6-aeca-de4776a5c4df tempest-TaggedAttachmentsTest-993234994 None] Created volume successfully.
Jun 29 04:43:34 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:43:35 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Flow 'volume_create_manager' (5371589d-53c5-4d56-9451-0fc86cb17659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c0306-52ac-4adc-a32f-4f0100c6cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c0306-52ac-4adc-a32f-4f0100c6cf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384098843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60a313c-50d1-4aa0-ae7f-c074f0c0932c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d26746e709b445b9770c820655db5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:44:01Z,use_quota=True,user_id='fd7f2417c57147f898a140d82f4b4423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10dee84-690b-411f-8a6e-155ccdd3ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10dee84-690b-411f-8a6e-155ccdd3ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5a9ecc-7010-4e8a-a2b0-47b5d42707b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5a9ecc-7010-4e8a-a2b0-47b5d42707b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60a313c-50d1-4aa0-ae7f-c074f0c0932c', 'volume_name': 'volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2599f70-698c-43e4-88cc-469109fea3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2599f70-698c-43e4-88cc-469109fea3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e97c09-53c6-4a1c-8505-493bf9c9fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Volume c60a313c-50d1-4aa0-ae7f-c074f0c0932c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c', 'volume_size': 1}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384098843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60a313c-50d1-4aa0-ae7f-c074f0c0932c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d26746e709b445b9770c820655db5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:44:01Z,use_quota=True,user_id='fd7f2417c57147f898a140d82f4b4423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Creating volume c60a313c-50d1-4aa0-ae7f-c074f0c0932c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:44:01 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:44:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:01 devstack sudo[94932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c 1073741824
Jun 29 04:44:01 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:03 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c 1073741824" returned: 0 in 1.798s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:03 devstack sudo[94941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c
Jun 29 04:44:03 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:03 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:44:03 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:04 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" returned: 0 in 1.495s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] <== create_volume: return (3397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.399s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Flow 'volume_create_manager' (39c43ab1-b509-467c-96b4-5730b0bac73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:44:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91979ad2-f012-4aa6-8f53-9ee10ac0af00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91979ad2-f012-4aa6-8f53-9ee10ac0af00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1442717534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4679f200-5833-4ccf-825f-1b3295562796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c2ac8e790e45b5b4df4ade1c18764d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:44:05Z,use_quota=True,user_id='793ae3126fb44639aca41c2d9059e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416a3ee7-8b0b-410d-b1b6-ee5dc88145f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416a3ee7-8b0b-410d-b1b6-ee5dc88145f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dda6dce-5c6c-43e9-8e75-4cefcf81975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dda6dce-5c6c-43e9-8e75-4cefcf81975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4679f200-5833-4ccf-825f-1b3295562796', 'volume_name': 'volume-4679f200-5833-4ccf-825f-1b3295562796', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a51881c-320b-4eab-a942-3e6cbf71af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a51881c-320b-4eab-a942-3e6cbf71af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e46ffe-b3f3-43f1-82fb-a8d8770f3522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Volume 4679f200-5833-4ccf-825f-1b3295562796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4679f200-5833-4ccf-825f-1b3295562796', 'volume_size': 1}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1442717534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4679f200-5833-4ccf-825f-1b3295562796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c2ac8e790e45b5b4df4ade1c18764d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:44:05Z,use_quota=True,user_id='793ae3126fb44639aca41c2d9059e8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Creating volume 4679f200-5833-4ccf-825f-1b3295562796 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:44:05 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:05 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 1073741824
Jun 29 04:44:05 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e97c09-53c6-4a1c-8505-493bf9c9fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd63c1a-39af-44fa-9e9a-b5a5d64526e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:05 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.930s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 6 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:44:05 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Volume volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c (c60a313c-50d1-4aa0-ae7f-c074f0c0932c): created successfully
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd63c1a-39af-44fa-9e9a-b5a5d64526e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Flow 'volume_create_manager' (5371589d-53c5-4d56-9451-0fc86cb17659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:44:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f888a6c8-7d9f-46f3-9814-dc61eb984ee5 tempest-DeleteServersTestJSON-1208666809 None] Created volume successfully.
Jun 29 04:44:06 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 1073741824" returned: 0 in 1.705s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:07 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796
Jun 29 04:44:07 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:08 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796" returned: 0 in 1.067s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] <== create_volume: return (2857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.867s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e46ffe-b3f3-43f1-82fb-a8d8770f3522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4679f200-5833-4ccf-825f-1b3295562796', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5cc970-2a0d-49c4-b3b2-0a883f252d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:44:08 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Volume volume-4679f200-5833-4ccf-825f-1b3295562796 (4679f200-5833-4ccf-825f-1b3295562796): created successfully
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5cc970-2a0d-49c4-b3b2-0a883f252d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:44:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Flow 'volume_create_manager' (39c43ab1-b509-467c-96b4-5730b0bac73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:44:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-85bc5abf-6b49-42de-9fe9-1210465dfe6e tempest-VolumesAdminNegativeTest-1842057731 None] Created volume successfully.
Jun 29 04:44:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Acquiring lock "cinder-4679f200-5833-4ccf-825f-1b3295562796-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:44:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "cinder-4679f200-5833-4ccf-825f-1b3295562796-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:44:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Acquiring lock "cinder-quobyte-4679f200-5833-4ccf-825f-1b3295562796" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:44:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "cinder-quobyte-4679f200-5833-4ccf-825f-1b3295562796" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:44:10 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2kj47twq/privsep.sock']
Jun 29 04:44:10 devstack sudo[94966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2kj47twq/privsep.sock
Jun 29 04:44:10 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 29 04:44:11 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING py.warnings [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jun 29 04:44:13 devstack cinder-volume[93723]:   .first()
Jun 29 04:44:13 devstack cinder-volume[93723]: 
Jun 29 04:44:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:13 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:13 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Spawned new privsep daemon via rootwrap
Jun 29 04:44:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Accepted privsep connection to /tmp/tmp2kj47twq/privsep.sock {{(pid=93723) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 29 04:44:13 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 29 04:44:13 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 29 04:44:13 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 29 04:44:13 devstack cinder-volume[93723]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94976
Jun 29 04:44:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5c9f73-75ff-4d03-abd9-6a7ec949ed70]: (2,) {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:44:13 devstack cinder-volume[93723]: WARNING oslo_privsep.priv_context [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] privsep daemon already running
Jun 29 04:44:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5f94c1-2838-4112-b628-5cc7dbaaa488]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:44:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5c253-2a04-4d83-a980-7b55651b2315]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:44:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:14 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c
Jun 29 04:44:14 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:14 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796
Jun 29 04:44:14 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:15 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:15 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" returned: 0 in 1.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.893s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796" returned: 0 in 1.750s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:15 devstack sudo[95004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796
Jun 29 04:44:15 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff9ae44a-fdc9-45f3-b7bf-6ce79f742571', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:44:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-bc01b6a2-0536-4619-9f0e-782e235b9b4e req-0a90ca66-c24d-44c4-ae17-bf7ac02cc323 tempest-DeleteServersTestJSON-1208666809 None] attachment_update completed successfully.
Jun 29 04:44:16 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4679f200-5833-4ccf-825f-1b3295562796" returned: 0 in 1.032s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "cinder-quobyte-4679f200-5833-4ccf-825f-1b3295562796" released by "delete_volume" :: held 6.726s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:44:17 devstack cinder-volume[93723]: WARNING cinder.quota [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:44:17 devstack cinder-volume[93723]: WARNING cinder.quota [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Created reservations ['a270203f-af5e-40c2-8418-8906755851e9', '09e66cf5-5911-463f-817f-a5587594b65e', '125b00ae-92b8-41b2-a576-973bd0443c50', '5ebe43e5-0371-4854-a55e-146409a01e4d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:17 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:44:17 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:18 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.250s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:18 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:44:18 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Deleted volume successfully.
Jun 29 04:44:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0f045ea8-3bec-4fd2-8066-2a199bd6b85d tempest-VolumesAdminNegativeTest-1842057731 None] Lock "cinder-4679f200-5833-4ccf-825f-1b3295562796-delete_volume" released by "delete_volume" :: held 8.541s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:44:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-e4d62032-7a58-450a-b821-342fc0bc9dc3 req-98e58384-b482-4e49-90d8-906b0bf41642 tempest-DeleteServersTestJSON-1208666809 None] Terminate volume connection completed successfully.
Jun 29 04:44:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e4d62032-7a58-450a-b821-342fc0bc9dc3 req-98e58384-b482-4e49-90d8-906b0bf41642 tempest-DeleteServersTestJSON-1208666809 None] Deleting attachment ff9ae44a-fdc9-45f3-b7bf-6ce79f742571. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "cinder-c60a313c-50d1-4aa0-ae7f-c074f0c0932c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "cinder-c60a313c-50d1-4aa0-ae7f-c074f0c0932c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "cinder-quobyte-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "cinder-quobyte-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b55ff5-98ea-4b74-a584-d062b1a9f738]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:44:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:30 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c
Jun 29 04:44:30 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:31 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" returned: 0 in 0.839s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:31 devstack sudo[95722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c
Jun 29 04:44:31 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:32 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" returned: 0 in 1.012s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "cinder-quobyte-c60a313c-50d1-4aa0-ae7f-c074f0c0932c" released by "delete_volume" :: held 1.904s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Created reservations ['8cad95c9-b9c8-4900-9a3b-3e8521d58183', '2b1e5a93-327e-4fd8-8aba-7488e303360e', '480448f4-6341-40d4-8c47-a36fca12c1e0', '96f498f5-1606-41ff-be39-4415ff3cf672'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:32 devstack sudo[95725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:44:32 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:33 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.139s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:33 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:44:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Deleted volume successfully.
Jun 29 04:44:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b4030df6-7630-4a64-afcd-030ff3e800ac tempest-DeleteServersTestJSON-1208666809 None] Lock "cinder-c60a313c-50d1-4aa0-ae7f-c074f0c0932c-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:44:42 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=23,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=3 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:44:43 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:44:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:44:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:44:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[738dfa68-a697-43a7-b5a4-def6479b5899]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:44:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:44:57 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798
Jun 29 04:44:57 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:44:58 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Jun 29 04:44:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" returned: 0 in 1.421s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:44:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.456s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:44:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f7dda9b-fea2-498c-b033-e2b822a6b2c3', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:44:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-6d30cf9a-6195-4512-9a76-a8ffdec90e95 req-f385a41b-51b6-4a0b-b232-fc9961fdf3b6 tempest-TaggedAttachmentsTest-993234994 None] attachment_update completed successfully.
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:03 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:45:03 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:04 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Flow 'volume_create_manager' (ff81d59b-c6fe-4813-b387-c7c2f94b61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc88a61-608a-485f-8f98-213a6f32dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc88a61-608a-485f-8f98-213a6f32dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2093677299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193d4a6d-f462-4769-829e-928d7c645c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c5ebc68a0d4409b6d3df75a1b5f71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:05Z,use_quota=True,user_id='4d769d411d454287961c67ca1fb2c7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b0461b-97e0-45b3-8c8d-1f00520c9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b0461b-97e0-45b3-8c8d-1f00520c9139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90678bed-aa33-4b7a-9806-e2e53bc2ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90678bed-aa33-4b7a-9806-e2e53bc2ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193d4a6d-f462-4769-829e-928d7c645c07', 'volume_name': 'volume-193d4a6d-f462-4769-829e-928d7c645c07', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7704ec97-d666-44ad-b12a-b2dc3ed0422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7704ec97-d666-44ad-b12a-b2dc3ed0422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dc0211-b5f8-45a6-a829-a94a5de51b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:05 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Volume 193d4a6d-f462-4769-829e-928d7c645c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193d4a6d-f462-4769-829e-928d7c645c07', 'volume_size': 1}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2093677299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193d4a6d-f462-4769-829e-928d7c645c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c5ebc68a0d4409b6d3df75a1b5f71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:05Z,use_quota=True,user_id='4d769d411d454287961c67ca1fb2c7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Creating volume 193d4a6d-f462-4769-829e-928d7c645c07 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:45:05 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:45:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:05 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 1073741824
Jun 29 04:45:05 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:06 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 1073741824" returned: 0 in 1.082s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:06 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07
Jun 29 04:45:06 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:07 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07" returned: 0 in 0.826s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17dc0211-b5f8-45a6-a829-a94a5de51b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193d4a6d-f462-4769-829e-928d7c645c07', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312ff49e-05f9-4415-8e50-d2f6cefd8261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Volume volume-193d4a6d-f462-4769-829e-928d7c645c07 (193d4a6d-f462-4769-829e-928d7c645c07): created successfully
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312ff49e-05f9-4415-8e50-d2f6cefd8261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Flow 'volume_create_manager' (ff81d59b-c6fe-4813-b387-c7c2f94b61b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f53bc46b-10b1-4384-b939-a3f4483cb4ec tempest-ServersNegativeTestJSON-2049446670 None] Created volume successfully.
Jun 29 04:45:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-510a3c74-00b5-4896-9912-7f6645591610 req-29616aff-cf7b-4e98-940c-23832e538812 tempest-TaggedAttachmentsTest-993234994 None] Terminate volume connection completed successfully.
Jun 29 04:45:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-510a3c74-00b5-4896-9912-7f6645591610 req-29616aff-cf7b-4e98-940c-23832e538812 tempest-TaggedAttachmentsTest-993234994 None] Deleting attachment 9f7dda9b-fea2-498c-b033-e2b822a6b2c3. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Flow 'volume_create_manager' (6784a26a-2f61-4d75-a7df-7a2dbf3255c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da236d6-1f60-41c2-9b55-886c907bd7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da236d6-1f60-41c2-9b55-886c907bd7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078066985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c2a7c5-3131-4a19-8129-8b20f27fba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c5ebc68a0d4409b6d3df75a1b5f71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:11Z,use_quota=True,user_id='4d769d411d454287961c67ca1fb2c7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e2043d-a553-48d3-9f47-e7abbe334271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e2043d-a553-48d3-9f47-e7abbe334271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46cd41d-f9ad-4fea-b28b-9883d86361c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46cd41d-f9ad-4fea-b28b-9883d86361c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c2a7c5-3131-4a19-8129-8b20f27fba9b', 'volume_name': 'volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bc4d20-e0c3-4454-b9f4-8ef4bf45ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bc4d20-e0c3-4454-b9f4-8ef4bf45ca27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e525efaf-dd34-453c-a0df-52584b788f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:11 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Volume 90c2a7c5-3131-4a19-8129-8b20f27fba9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b', 'volume_size': 1}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1078066985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c2a7c5-3131-4a19-8129-8b20f27fba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c5ebc68a0d4409b6d3df75a1b5f71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:11Z,use_quota=True,user_id='4d769d411d454287961c67ca1fb2c7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Creating volume 90c2a7c5-3131-4a19-8129-8b20f27fba9b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:45:11 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:45:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:11 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b 1073741824
Jun 29 04:45:11 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:12 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b 1073741824" returned: 0 in 0.906s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:12 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b
Jun 29 04:45:12 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:12 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b" returned: 0 in 0.726s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e525efaf-dd34-453c-a0df-52584b788f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8941ad6-e1fc-4ec0-b8d8-1192dffd9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Volume volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b (90c2a7c5-3131-4a19-8129-8b20f27fba9b): created successfully
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8941ad6-e1fc-4ec0-b8d8-1192dffd9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Flow 'volume_create_manager' (6784a26a-2f61-4d75-a7df-7a2dbf3255c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-538c2dfa-066a-4b07-87d5-3c83cd0b14b4 tempest-ServersNegativeTestJSON-2049446670 None] Created volume successfully.
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "cinder-90c2a7c5-3131-4a19-8129-8b20f27fba9b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-90c2a7c5-3131-4a19-8129-8b20f27fba9b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "cinder-quobyte-90c2a7c5-3131-4a19-8129-8b20f27fba9b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-quobyte-90c2a7c5-3131-4a19-8129-8b20f27fba9b" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb318a-e2cb-43a4-b66b-c97a688b769b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:45:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:14 devstack sudo[96570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b
Jun 29 04:45:14 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:14 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b" returned: 0 in 0.828s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:14 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b
Jun 29 04:45:14 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:15 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-90c2a7c5-3131-4a19-8129-8b20f27fba9b" returned: 0 in 0.673s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-quobyte-90c2a7c5-3131-4a19-8129-8b20f27fba9b" released by "delete_volume" :: held 1.551s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Created reservations ['9e7ae87b-23fe-4951-ace0-2ac5c39e04ef', 'c82462e0-105a-4a73-b53d-6d2e1bebe599', 'f7c47dfb-54da-4174-9c95-50b41af6469a', '47f7d1ae-6ef1-47c3-878e-577a1093d565'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:15 devstack sudo[96585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:45:15 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "cinder-193d4a6d-f462-4769-829e-928d7c645c07-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-193d4a6d-f462-4769-829e-928d7c645c07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "cinder-quobyte-193d4a6d-f462-4769-829e-928d7c645c07" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-quobyte-193d4a6d-f462-4769-829e-928d7c645c07" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8575528-acbf-41f7-bff0-e231f41d0ef6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:16 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:45:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Deleted volume successfully.
Jun 29 04:45:16 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07
Jun 29 04:45:16 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2d3b90fd-7873-4774-941f-22332ae09745 tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-90c2a7c5-3131-4a19-8129-8b20f27fba9b-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:17 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07" returned: 0 in 1.237s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:17 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07
Jun 29 04:45:17 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:18 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-193d4a6d-f462-4769-829e-928d7c645c07" returned: 0 in 1.395s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-quobyte-193d4a6d-f462-4769-829e-928d7c645c07" released by "delete_volume" :: held 2.699s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:18 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Created reservations ['21adfdf4-7050-42d3-86d9-9576ee1b3e67', 'a9dd309d-2896-4102-8d43-4bdc31e3ac7b', 'f1173aca-21a0-4d14-960f-b2b9618d0b99', 'fa4e961b-feb4-49cb-afbb-f65f93d815cd'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:19 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:45:19 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:20 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.306s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:20 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:45:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Deleted volume successfully.
Jun 29 04:45:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bb59d7ad-2d4f-4643-b8e1-62d80b3d724e tempest-ServersNegativeTestJSON-2049446670 None] Lock "cinder-193d4a6d-f462-4769-829e-928d7c645c07-delete_volume" released by "delete_volume" :: held 4.438s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:29 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=15,cinder:UPDATE=27,cinder:INSERT=7 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "cinder-7f2476b0-4f96-4f77-83a8-2da5ca9ef798-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "cinder-7f2476b0-4f96-4f77-83a8-2da5ca9ef798-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "cinder-quobyte-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "cinder-quobyte-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6111160-c631-4240-aab0-01b20e35e132]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:45:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:30 devstack sudo[96886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798
Jun 29 04:45:30 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:31 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" returned: 0 in 1.292s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:31 devstack sudo[96916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798
Jun 29 04:45:31 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:32 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" returned: 0 in 0.870s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "cinder-quobyte-7f2476b0-4f96-4f77-83a8-2da5ca9ef798" released by "delete_volume" :: held 2.247s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Created reservations ['02e1acaa-7a05-4228-8ec4-7736a0a079f3', '5c5306f7-e482-4e30-838b-a18b0d461d58', 'a3261da9-57d3-4ad8-bd2d-44bf7405261a', '3e1060d7-c27b-4326-a197-5e46d28dd5bd'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:32 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:45:32 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:33 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.813s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:33 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:45:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Deleted volume successfully.
Jun 29 04:45:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d57b073c-3b3f-47b9-bbbc-ee5df2f12c40 tempest-TaggedAttachmentsTest-993234994 None] Lock "cinder-7f2476b0-4f96-4f77-83a8-2da5ca9ef798-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:45:42 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=6 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Flow 'volume_create_manager' (2fd4dffc-f44a-49bf-942c-0f577b16035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afd01ed-e7d3-4136-95bf-750fdc6398e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afd01ed-e7d3-4136-95bf-750fdc6398e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-444220224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd8cbc-a57e-4240-81af-4b71b64cc852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c265c83315f44301a5bd969423118cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:43Z,use_quota=True,user_id='326a6bae44e441e9a92971a4d2247b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722b735e-188d-4e50-ac4c-8fd292f96e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722b735e-188d-4e50-ac4c-8fd292f96e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d40d3-5110-444e-86a2-32e7f03a8df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d40d3-5110-444e-86a2-32e7f03a8df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dd8cbc-a57e-4240-81af-4b71b64cc852', 'volume_name': 'volume-41dd8cbc-a57e-4240-81af-4b71b64cc852', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9525bde8-d67a-432c-b7de-bc93a08804ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9525bde8-d67a-432c-b7de-bc93a08804ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d47bb5-2dfc-4b05-8e31-85f7789043f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:43 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Volume 41dd8cbc-a57e-4240-81af-4b71b64cc852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dd8cbc-a57e-4240-81af-4b71b64cc852', 'volume_size': 1}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-444220224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dd8cbc-a57e-4240-81af-4b71b64cc852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c265c83315f44301a5bd969423118cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:43Z,use_quota=True,user_id='326a6bae44e441e9a92971a4d2247b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Creating volume 41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:45:43 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:45:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:43 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 1073741824
Jun 29 04:45:43 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:44 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 1073741824" returned: 0 in 1.398s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:44 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852
Jun 29 04:45:44 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:45 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852" returned: 0 in 0.832s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d47bb5-2dfc-4b05-8e31-85f7789043f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dd8cbc-a57e-4240-81af-4b71b64cc852', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05030caa-2f3f-459c-a5c3-eb0a399063b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Volume volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 (41dd8cbc-a57e-4240-81af-4b71b64cc852): created successfully
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05030caa-2f3f-459c-a5c3-eb0a399063b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Flow 'volume_create_manager' (2fd4dffc-f44a-49bf-942c-0f577b16035d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d2e80529-f626-4585-b030-f407d74e04e8 tempest-ServerActionsTestOtherA-521516757 None] Created volume successfully.
Jun 29 04:45:55 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:45:55 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (f9869909-80e6-46cb-85c5-ff005f712f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931c14b4-71aa-4597-a1e4-fe2842ed842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931c14b4-71aa-4597-a1e4-fe2842ed842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-363430980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e12584c-12a4-4425-8314-2df4b15a3b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:57Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ec7f0-8de0-4289-b1b3-17c2c96790d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ec7f0-8de0-4289-b1b3-17c2c96790d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f6a038-ca80-4201-9325-dbaa9c00b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f6a038-ca80-4201-9325-dbaa9c00b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e12584c-12a4-4425-8314-2df4b15a3b0c', 'volume_name': 'volume-8e12584c-12a4-4425-8314-2df4b15a3b0c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9b3a7-23cb-4bd9-bdd0-a84c78878cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9b3a7-23cb-4bd9-bdd0-a84c78878cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac3febb-af3c-49be-8e5e-0b82e1f928a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:57 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Volume 8e12584c-12a4-4425-8314-2df4b15a3b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e12584c-12a4-4425-8314-2df4b15a3b0c', 'volume_size': 1}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-363430980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e12584c-12a4-4425-8314-2df4b15a3b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:45:57Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Creating volume 8e12584c-12a4-4425-8314-2df4b15a3b0c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:45:57 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:45:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:57 devstack sudo[97004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c 1073741824
Jun 29 04:45:57 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:58 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c 1073741824" returned: 0 in 1.286s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:45:58 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c
Jun 29 04:45:58 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:45:59 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c" returned: 0 in 0.830s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac3febb-af3c-49be-8e5e-0b82e1f928a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e12584c-12a4-4425-8314-2df4b15a3b0c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b9f129-ca46-492e-8a3a-27e559617f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:45:59 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Volume volume-8e12584c-12a4-4425-8314-2df4b15a3b0c (8e12584c-12a4-4425-8314-2df4b15a3b0c): created successfully
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b9f129-ca46-492e-8a3a-27e559617f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:45:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (f9869909-80e6-46cb-85c5-ff005f712f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:45:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6312077b-3a72-467e-978c-b5d1dfb35bfc tempest-AttachVolumeNegativeTest-1582855579 None] Created volume successfully.
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:03 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:46:03 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad3b7e-0d83-412e-8390-5bb78dafcbf8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:46:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:03 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c
Jun 29 04:46:03 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:05 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.686s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:46:05 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c" returned: 0 in 1.520s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.576s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-8e12584c-12a4-4425-8314-2df4b15a3b0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '105c812e-a172-43fe-b836-d0358292f671', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:46:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-d3037640-abec-4471-82d0-a45c0d2754a2 req-467fc89b-b655-43dd-9ef7-cd928a11eb60 tempest-AttachVolumeNegativeTest-1582855579 None] attachment_update completed successfully.
Jun 29 04:46:15 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:46:15 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:46:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:33 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a2ff9-e4a8-42b8-bf68-bbf4465aa1a0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:46:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:33 devstack sudo[97974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852
Jun 29 04:46:33 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:34 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852" returned: 0 in 1.001s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.023s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-41dd8cbc-a57e-4240-81af-4b71b64cc852', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b048653-6c81-4ea5-904b-18d5a3643b7c', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:46:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-3f50b797-2a8f-4e27-a841-f35f362487c7 req-75c50f6a-feeb-47c3-b5ec-10508901b4b9 tempest-ServerActionsTestOtherA-521516757 None] attachment_update completed successfully.
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Flow 'volume_create_manager' (ae6fb784-52dc-4aac-bb00-af232953d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec887d5-e381-4239-9cc7-4c0eccacc935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec887d5-e381-4239-9cc7-4c0eccacc935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1712190053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc05532-8dcd-411d-ba4c-47dc88539615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3668d1f15860418ea6a83e417b431777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:46:40Z,use_quota=True,user_id='a5dc0c2beed84fca85d0f87473563de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be392e6-e3ee-4c19-89b0-d05f4e3bfcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be392e6-e3ee-4c19-89b0-d05f4e3bfcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb681668-6573-4501-bc7b-cbab3580b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb681668-6573-4501-bc7b-cbab3580b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc05532-8dcd-411d-ba4c-47dc88539615', 'volume_name': 'volume-2dc05532-8dcd-411d-ba4c-47dc88539615', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731a520e-5508-46c1-aed5-79d7f7a2bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731a520e-5508-46c1-aed5-79d7f7a2bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a423577a-e793-4ceb-8658-7f686a333fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Volume 2dc05532-8dcd-411d-ba4c-47dc88539615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc05532-8dcd-411d-ba4c-47dc88539615', 'volume_size': 1}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1712190053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc05532-8dcd-411d-ba4c-47dc88539615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3668d1f15860418ea6a83e417b431777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:46:40Z,use_quota=True,user_id='a5dc0c2beed84fca85d0f87473563de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Creating volume 2dc05532-8dcd-411d-ba4c-47dc88539615 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:46:39 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:46:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:39 devstack sudo[98019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 1073741824
Jun 29 04:46:39 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:40 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 1073741824" returned: 0 in 1.041s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:40 devstack sudo[98041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615
Jun 29 04:46:40 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:41 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615" returned: 0 in 0.784s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a423577a-e793-4ceb-8658-7f686a333fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc05532-8dcd-411d-ba4c-47dc88539615', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10990c20-22bd-40cf-8179-98c41612c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Volume volume-2dc05532-8dcd-411d-ba4c-47dc88539615 (2dc05532-8dcd-411d-ba4c-47dc88539615): created successfully
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10990c20-22bd-40cf-8179-98c41612c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Flow 'volume_create_manager' (ae6fb784-52dc-4aac-bb00-af232953d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:46:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-711b771e-37a6-48d1-986d-5d682fd89ad0 tempest-AttachVolumeShelveTestJSON-1611765062 None] Created volume successfully.
Jun 29 04:46:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-715dc184-5a1b-41d7-9609-27a81fe29d26 tempest-ServerActionsTestOtherA-521516757 None] Terminate volume connection completed successfully.
Jun 29 04:46:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-715dc184-5a1b-41d7-9609-27a81fe29d26 tempest-ServerActionsTestOtherA-521516757 None] Deleting attachment 9b048653-6c81-4ea5-904b-18d5a3643b7c. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:46:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67d09b-bfda-42ba-a370-788f2386719e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:46:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:46 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852
Jun 29 04:46:46 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:47 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852" returned: 0 in 1.064s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.095s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-41dd8cbc-a57e-4240-81af-4b71b64cc852', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b71fc6c4-c60a-4ba6-ba9d-e9b4816c02b0', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:46:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-c4c2ea53-13c3-432e-81f2-a6bcaaeb4ead req-7761ca3e-4b58-4836-b304-792d51996f1e tempest-ServerActionsTestOtherA-521516757 None] attachment_update completed successfully.
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (5497f27b-1551-44db-9e99-2d0fe2fe3483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51ea5d7-703e-4049-973c-71f2d975e9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51ea5d7-703e-4049-973c-71f2d975e9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1655775332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7e23e-eab4-4982-8aae-fd9de3c857c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:46:51Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01880c2-d5b3-49c7-9a6f-ea1a098336f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01880c2-d5b3-49c7-9a6f-ea1a098336f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8383ce0-8276-46b1-a8ab-423b05842381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8383ce0-8276-46b1-a8ab-423b05842381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb7e23e-eab4-4982-8aae-fd9de3c857c2', 'volume_name': 'volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a9cbf1-9f21-4ea2-8691-abbc36cee243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a9cbf1-9f21-4ea2-8691-abbc36cee243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e112097-9ab7-4aa9-a785-f08e6aa1b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Volume 1eb7e23e-eab4-4982-8aae-fd9de3c857c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2', 'volume_size': 1}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1655775332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7e23e-eab4-4982-8aae-fd9de3c857c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:46:51Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Creating volume 1eb7e23e-eab4-4982-8aae-fd9de3c857c2 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:46:50 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:46:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:50 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 1073741824
Jun 29 04:46:51 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:51 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 1073741824" returned: 0 in 0.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:52 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2
Jun 29 04:46:52 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:52 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" returned: 0 in 0.717s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e112097-9ab7-4aa9-a785-f08e6aa1b94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e5cb5c-4ef5-428f-96a0-d567f800e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:46:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Volume volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 (1eb7e23e-eab4-4982-8aae-fd9de3c857c2): created successfully
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e5cb5c-4ef5-428f-96a0-d567f800e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:46:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (5497f27b-1551-44db-9e99-2d0fe2fe3483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:46:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1eb4238b-6068-4af3-b451-1e699f8609fb tempest-AttachVolumeTestJSON-595866368 None] Created volume successfully.
Jun 29 04:46:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:46:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:46:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebc0d6-2a18-4d2a-adda-bb3ce822e663]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:46:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:46:56 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2
Jun 29 04:46:56 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:46:57 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Jun 29 04:46:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" returned: 0 in 1.038s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:46:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.060s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:46:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5e56ccd-dd6b-40cb-b089-ec1e83c08433', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:46:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-d1afe159-d321-45e1-a3d2-29b9615f9636 req-54d09854-d0f2-401a-a14d-802641dd4c63 tempest-AttachVolumeTestJSON-595866368 None] attachment_update completed successfully.
Jun 29 04:46:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9e125d0b-147d-4098-86b8-41b76240491d req-496c7535-2739-410a-bb39-a3ae106f28b2 tempest-AttachVolumeShelveTestJSON-1611765062 None] No connector for attachment 499be214-7f32-4558-9a8c-8d23c41f7bc0; skipping storage backend terminate_connection call. {{(pid=93723) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 29 04:46:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9e125d0b-147d-4098-86b8-41b76240491d req-496c7535-2739-410a-bb39-a3ae106f28b2 tempest-AttachVolumeShelveTestJSON-1611765062 None] Deleting attachment 499be214-7f32-4558-9a8c-8d23c41f7bc0. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:47:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:03 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:47:03 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:04 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:47:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:47:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:47:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:47:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-db8186ea-1843-421e-88e5-7f0464a92364 req-5510007f-f7e2-450e-b3eb-fc5987cdf67e tempest-AttachVolumeNegativeTest-1582855579 None] Terminate volume connection completed successfully.
Jun 29 04:47:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-db8186ea-1843-421e-88e5-7f0464a92364 req-5510007f-f7e2-450e-b3eb-fc5987cdf67e tempest-AttachVolumeNegativeTest-1582855579 None] Deleting attachment 105c812e-a172-43fe-b836-d0358292f671. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:47:19 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=25,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:47:19 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=9,cinder:SELECT=23,cinder:INSERT=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:47:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-aa95436a-aa1f-4d71-8341-a82310efab85 req-32eee38b-0d75-4e5d-a0f4-d5efc73a60e7 tempest-ServerActionsTestOtherA-521516757 None] Terminate volume connection completed successfully.
Jun 29 04:47:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-aa95436a-aa1f-4d71-8341-a82310efab85 req-32eee38b-0d75-4e5d-a0f4-d5efc73a60e7 tempest-ServerActionsTestOtherA-521516757 None] Deleting attachment b71fc6c4-c60a-4ba6-ba9d-e9b4816c02b0. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:47:31 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "cinder-41dd8cbc-a57e-4240-81af-4b71b64cc852-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "cinder-41dd8cbc-a57e-4240-81af-4b71b64cc852-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "cinder-quobyte-41dd8cbc-a57e-4240-81af-4b71b64cc852" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "cinder-quobyte-41dd8cbc-a57e-4240-81af-4b71b64cc852" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b4c5f2-5a8f-4c31-a29b-2394d7626a99]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:47:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:35 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852
Jun 29 04:47:35 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:36 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852" returned: 0 in 0.808s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:36 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852
Jun 29 04:47:36 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:37 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41dd8cbc-a57e-4240-81af-4b71b64cc852" returned: 0 in 0.715s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "cinder-quobyte-41dd8cbc-a57e-4240-81af-4b71b64cc852" released by "delete_volume" :: held 1.575s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Created reservations ['18443c96-1fb8-4713-9b00-f91ff082d51a', '2d33bf48-0c1a-4711-b38f-9685ae4ff04e', '14b6c53d-8e3f-4fb5-a82a-edbc6e34990e', '5037ba55-d27d-4b85-b9e4-47ad33995372'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:47:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:37 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:47:37 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:38 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.755s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:38 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:47:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Deleted volume successfully.
Jun 29 04:47:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7088321-4e1e-46dc-bc14-a7e5052e48f3 tempest-ServerActionsTestOtherA-521516757 None] Lock "cinder-41dd8cbc-a57e-4240-81af-4b71b64cc852-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:47:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-33defcc6-ee31-484b-a4f5-9357b7d4f20c req-80d5381c-820c-4f35-93e8-b2b376708bae tempest-AttachVolumeTestJSON-595866368 None] Terminate volume connection completed successfully.
Jun 29 04:47:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-33defcc6-ee31-484b-a4f5-9357b7d4f20c req-80d5381c-820c-4f35-93e8-b2b376708bae tempest-AttachVolumeTestJSON-595866368 None] Deleting attachment c5e56ccd-dd6b-40cb-b089-ec1e83c08433. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:47:54 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:47:54 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Acquiring lock "cinder-2dc05532-8dcd-411d-ba4c-47dc88539615-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "cinder-2dc05532-8dcd-411d-ba4c-47dc88539615-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Acquiring lock "cinder-quobyte-2dc05532-8dcd-411d-ba4c-47dc88539615" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "cinder-quobyte-2dc05532-8dcd-411d-ba4c-47dc88539615" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef188c9-16bd-45b5-a102-a6f4821850e1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:47:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:57 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615
Jun 29 04:47:57 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:58 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615" returned: 0 in 0.878s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:58 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615
Jun 29 04:47:58 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:47:59 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2dc05532-8dcd-411d-ba4c-47dc88539615" returned: 0 in 0.718s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "cinder-quobyte-2dc05532-8dcd-411d-ba4c-47dc88539615" released by "delete_volume" :: held 1.662s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Created reservations ['cbce9e9d-f5ae-4bd6-b9c0-179bc194294e', '1d3aedec-a61a-4e49-b035-8e13a1e65f43', '63a12653-808a-4342-aeab-e7b99c1cd6aa', 'f6c057e7-d33d-49c3-b70c-23096dd15c62'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:47:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:47:59 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:47:59 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:00 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.988s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:00 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:00 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Deleted volume successfully.
Jun 29 04:48:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bd285648-26da-4368-b05b-bb131cffaeeb tempest-AttachVolumeShelveTestJSON-1611765062 None] Lock "cinder-2dc05532-8dcd-411d-ba4c-47dc88539615-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:03 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:48:03 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:04 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.906s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:48:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:48:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:48:09 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:48:10 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (571f8d92-be49-4ea9-80ac-ee60e775646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84623e04-a7ca-4073-a6d1-037e4918e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84623e04-a7ca-4073-a6d1-037e4918e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-255183082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed311c36-ff3e-4cfb-94df-fb8e0841e1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:12Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a91869-295c-4db0-b98e-8176dd749de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a91869-295c-4db0-b98e-8176dd749de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fec0fa-a48d-4dea-ae1e-1b89774f74be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fec0fa-a48d-4dea-ae1e-1b89774f74be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed311c36-ff3e-4cfb-94df-fb8e0841e1cb', 'volume_name': 'volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d8ef94-2186-452f-b2bf-e76266ab9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d8ef94-2186-452f-b2bf-e76266ab9602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63161a7-e90d-4f61-b89b-cf9f7ce8d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Volume ed311c36-ff3e-4cfb-94df-fb8e0841e1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb', 'volume_size': 1}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-255183082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed311c36-ff3e-4cfb-94df-fb8e0841e1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:12Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Creating volume ed311c36-ff3e-4cfb-94df-fb8e0841e1cb {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:12 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb 1073741824
Jun 29 04:48:12 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:13 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb 1073741824" returned: 0 in 1.505s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:14 devstack sudo[99531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb
Jun 29 04:48:14 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:14 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63161a7-e90d-4f61-b89b-cf9f7ce8d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c399e-a851-41b9-abbf-597eac1c0401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Volume volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb (ed311c36-ff3e-4cfb-94df-fb8e0841e1cb): created successfully
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c399e-a851-41b9-abbf-597eac1c0401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (571f8d92-be49-4ea9-80ac-ee60e775646e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-daf0e05d-df00-4fb6-8fed-e7b66136ba52 tempest-AttachVolumeNegativeTest-1582855579 None] Created volume successfully.
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Flow 'volume_create_manager' (5b1491e0-e9d3-4f02-9530-7d09450278b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8db61a-3527-4ba4-b62e-fe7f410b5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8db61a-3527-4ba4-b62e-fe7f410b5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-766808676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ae4331-16ab-4e91-9a4e-cefe1a75a1ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a381d2e45b174bdbb1438a4c7ff39fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:15Z,use_quota=True,user_id='c8ba9c8002584dbabd730abdde772e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebca1b74-dd79-4f73-86d7-64d6d815c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebca1b74-dd79-4f73-86d7-64d6d815c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17b68fc-ffb8-4e00-b3a1-f61ecea97b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17b68fc-ffb8-4e00-b3a1-f61ecea97b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ae4331-16ab-4e91-9a4e-cefe1a75a1ec', 'volume_name': 'volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf7781f-f60f-4064-bde3-186afb6e7006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf7781f-f60f-4064-bde3-186afb6e7006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c04a45-f124-4251-8ebf-8547a91da106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:15 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Volume 52ae4331-16ab-4e91-9a4e-cefe1a75a1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec', 'volume_size': 1}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-766808676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ae4331-16ab-4e91-9a4e-cefe1a75a1ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a381d2e45b174bdbb1438a4c7ff39fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:15Z,use_quota=True,user_id='c8ba9c8002584dbabd730abdde772e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Creating volume 52ae4331-16ab-4e91-9a4e-cefe1a75a1ec {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:15 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:15 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec 1073741824
Jun 29 04:48:15 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:16 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec 1073741824" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:16 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec
Jun 29 04:48:16 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:16 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" returned: 0 in 0.640s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c04a45-f124-4251-8ebf-8547a91da106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21faaf99-a807-464c-8ec2-034a46454ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Volume volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec (52ae4331-16ab-4e91-9a4e-cefe1a75a1ec): created successfully
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21faaf99-a807-464c-8ec2-034a46454ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Flow 'volume_create_manager' (5b1491e0-e9d3-4f02-9530-7d09450278b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-9f4fc245-c15f-41a1-b646-19eb44afca97 req-9f64598c-9161-4b99-9e70-431c9a64c0f0 tempest-VolumesGetTestJSON-1759084383 None] Created volume successfully.
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Acquiring lock "cinder-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "cinder-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Acquiring lock "cinder-quobyte-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "cinder-quobyte-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6745b2-a1ef-4d70-8af9-c31e72d48136]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:48:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:17 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec
Jun 29 04:48:17 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:18 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" returned: 0 in 0.989s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:18 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec
Jun 29 04:48:18 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d91e2c-a223-4f61-bae3-44f24106c35f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:48:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:19 devstack sudo[99565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb
Jun 29 04:48:19 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:19 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" returned: 0 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "cinder-quobyte-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec" released by "delete_volume" :: held 1.847s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG cinder.quota [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Created reservations ['da877399-dbe6-498c-a48c-7b5399c8fc53', '4a671e11-2755-4085-9541-5f95ae7a301d', '95fbad97-6926-4765-b880-e313c9afec29', 'ecd2bb02-ce8f-485b-a7e4-dcecab503768'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:19 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:48:19 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:20 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" returned: 0 in 1.034s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.058s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69058aad-3674-45d0-9d7f-304c4981e000', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:48:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-97fb152a-e8a1-4d0a-9618-72c3bb9f2bf1 req-39e7a125-8a19-431d-bb8b-4e9e3ecd506a tempest-AttachVolumeNegativeTest-1582855579 None] attachment_update completed successfully.
Jun 29 04:48:20 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.120s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG cinder.manager [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Deleted volume successfully.
Jun 29 04:48:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-83dc5f91-7d05-4b00-a415-049e3668fae0 req-d0217761-58ea-4fc7-9dfc-92b2cd47885e tempest-VolumesGetTestJSON-1759084383 None] Lock "cinder-52ae4331-16ab-4e91-9a4e-cefe1a75a1ec-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (c49809e1-6121-4090-bdbc-324cf066c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056eb3a2-d3b4-4170-ae51-62744f77eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056eb3a2-d3b4-4170-ae51-62744f77eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1271561735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab5c84b-e634-44a6-92c1-a6b4a58a7815,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:25Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb87b39c-4562-4fd7-b7c0-0250783691d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb87b39c-4562-4fd7-b7c0-0250783691d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8e8a86-90b8-4f36-b16e-1d5d0286b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8e8a86-90b8-4f36-b16e-1d5d0286b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab5c84b-e634-44a6-92c1-a6b4a58a7815', 'volume_name': 'volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e117018b-a273-4f22-ab54-23bd000e2fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e117018b-a273-4f22-ab54-23bd000e2fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d96982-fea0-4827-9f53-c75eed2d5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Volume aab5c84b-e634-44a6-92c1-a6b4a58a7815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815', 'volume_size': 1}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1271561735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab5c84b-e634-44a6-92c1-a6b4a58a7815,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:25Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Creating volume aab5c84b-e634-44a6-92c1-a6b4a58a7815 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:24 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:24 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 1073741824
Jun 29 04:48:24 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:25 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 1073741824" returned: 0 in 0.901s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:25 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815
Jun 29 04:48:25 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:26 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815" returned: 0 in 1.044s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d96982-fea0-4827-9f53-c75eed2d5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d49d0b6-5b39-42cc-9065-2901c9861518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Volume volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 (aab5c84b-e634-44a6-92c1-a6b4a58a7815): created successfully
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d49d0b6-5b39-42cc-9065-2901c9861518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (c49809e1-6121-4090-bdbc-324cf066c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a7663e6d-82d9-4013-a4a0-eccb276a21c8 tempest-VolumesTestJSON-573921995 None] Created volume successfully.
Jun 29 04:48:27 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-286ac8ff-901a-4d11-a83e-24791060faac req-504f0e7d-fa57-4375-be84-472f40869e32 tempest-AttachVolumeNegativeTest-1582855579 None] Terminate volume connection completed successfully.
Jun 29 04:48:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-286ac8ff-901a-4d11-a83e-24791060faac req-504f0e7d-fa57-4375-be84-472f40869e32 tempest-AttachVolumeNegativeTest-1582855579 None] Deleting attachment 69058aad-3674-45d0-9d7f-304c4981e000. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (f1093a2d-2347-44e0-8c2f-22d849c34106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427b06ce-a5c0-40be-92de-aaed214f99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427b06ce-a5c0-40be-92de-aaed214f99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1603443459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3058b0a5-0959-4626-bc47-b2e1dcab0177,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:29Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e97cb9-cabb-4035-8e28-07eb84608181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e97cb9-cabb-4035-8e28-07eb84608181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772c4e63-9fd0-40b9-af67-326662bd55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772c4e63-9fd0-40b9-af67-326662bd55e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3058b0a5-0959-4626-bc47-b2e1dcab0177', 'volume_name': 'volume-3058b0a5-0959-4626-bc47-b2e1dcab0177', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1272bb-96d2-4322-8ab4-8efbc55495ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1272bb-96d2-4322-8ab4-8efbc55495ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e5825-6a43-4036-9714-613313ceb1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:29 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Volume 3058b0a5-0959-4626-bc47-b2e1dcab0177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3058b0a5-0959-4626-bc47-b2e1dcab0177', 'volume_size': 1}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1603443459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3058b0a5-0959-4626-bc47-b2e1dcab0177,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:29Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Creating volume 3058b0a5-0959-4626-bc47-b2e1dcab0177 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:29 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:29 devstack sudo[100209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 1073741824
Jun 29 04:48:29 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:32 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 1073741824" returned: 0 in 2.554s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:32 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177
Jun 29 04:48:32 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:33 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177" returned: 0 in 1.520s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] <== create_volume: return (4259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.264s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95e5825-6a43-4036-9714-613313ceb1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3058b0a5-0959-4626-bc47-b2e1dcab0177', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46cf932-0226-4db6-ab25-cf84f4d2c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Volume volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 (3058b0a5-0959-4626-bc47-b2e1dcab0177): created successfully
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46cf932-0226-4db6-ab25-cf84f4d2c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (f1093a2d-2347-44e0-8c2f-22d849c34106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f9d8d32c-e542-4015-8225-d09acf8bdce9 tempest-VolumesTestJSON-573921995 None] Created volume successfully.
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (f4720db9-e525-473d-b265-5c778b6368e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71c3aea-78e7-4938-985a-7039ace397a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71c3aea-78e7-4938-985a-7039ace397a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767903191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a96bc0-0b21-4321-96c8-d3395e4a2852,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:37Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d38920-7f08-41e7-86de-d1ca72e92ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d38920-7f08-41e7-86de-d1ca72e92ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e38a35c-436e-4bf4-8f19-f0ea08ef0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e38a35c-436e-4bf4-8f19-f0ea08ef0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a96bc0-0b21-4321-96c8-d3395e4a2852', 'volume_name': 'volume-54a96bc0-0b21-4321-96c8-d3395e4a2852', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61487ef8-6621-4ce2-a3f5-82b8c8491abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61487ef8-6621-4ce2-a3f5-82b8c8491abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfdbf0d-38c0-433e-a337-878026d80bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Volume 54a96bc0-0b21-4321-96c8-d3395e4a2852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a96bc0-0b21-4321-96c8-d3395e4a2852', 'volume_size': 1}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767903191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a96bc0-0b21-4321-96c8-d3395e4a2852,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4e9e9b1464e4f4aafe156983aeaad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:37Z,use_quota=True,user_id='18cc6898c7464d979b7a0c0db6700e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Creating volume 54a96bc0-0b21-4321-96c8-d3395e4a2852 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:37 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:37 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 1073741824
Jun 29 04:48:37 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:38 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 1073741824" returned: 0 in 1.583s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:39 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852
Jun 29 04:48:39 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:39 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852" returned: 0 in 0.972s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] <== create_volume: return (2674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.682s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfdbf0d-38c0-433e-a337-878026d80bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a96bc0-0b21-4321-96c8-d3395e4a2852', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6badca2-55b3-4bf0-8650-2d1e4cf4ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Volume volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 (54a96bc0-0b21-4321-96c8-d3395e4a2852): created successfully
Jun 29 04:48:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6badca2-55b3-4bf0-8650-2d1e4cf4ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Flow 'volume_create_manager' (f4720db9-e525-473d-b265-5c778b6368e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-231c94ce-e9a3-4b40-85fb-2d2f402d006c tempest-VolumesTestJSON-573921995 None] Created volume successfully.
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-54a96bc0-0b21-4321-96c8-d3395e4a2852-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "cinder-54a96bc0-0b21-4321-96c8-d3395e4a2852-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-quobyte-54a96bc0-0b21-4321-96c8-d3395e4a2852" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-54a96bc0-0b21-4321-96c8-d3395e4a2852" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9318b-65dd-4b5c-8641-0830379b912e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:48:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:43 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852
Jun 29 04:48:43 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:44 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852" returned: 0 in 0.938s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:44 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852
Jun 29 04:48:44 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:45 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54a96bc0-0b21-4321-96c8-d3395e4a2852" returned: 0 in 0.835s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-54a96bc0-0b21-4321-96c8-d3395e4a2852" released by "delete_volume" :: held 1.829s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Created reservations ['a5b131aa-6999-4f99-a00e-606b99e0cf45', '05cf4633-5f8c-41cc-af53-5a022462d265', '06d46c67-473e-4296-8af7-ebcb3e25c40b', 'e570a1b3-ac30-4574-bd80-ba3578fa3ce4'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:45 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:48:45 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-3058b0a5-0959-4626-bc47-b2e1dcab0177-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "cinder-3058b0a5-0959-4626-bc47-b2e1dcab0177-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-quobyte-3058b0a5-0959-4626-bc47-b2e1dcab0177" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-3058b0a5-0959-4626-bc47-b2e1dcab0177" acquired by "delete_volume" :: waited 0.048s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4875b7-dda9-4c68-8c89-5b27fa869148]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:48:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:45 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177
Jun 29 04:48:45 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:46 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.959s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:46 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Deleted volume successfully.
Jun 29 04:48:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-de906833-b606-4361-ae65-924cb10e1157 tempest-VolumesTestJSON-573921995 None] Lock "cinder-54a96bc0-0b21-4321-96c8-d3395e4a2852-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:46 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177" returned: 0 in 0.784s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:46 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177
Jun 29 04:48:46 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:47 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3058b0a5-0959-4626-bc47-b2e1dcab0177" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-3058b0a5-0959-4626-bc47-b2e1dcab0177" released by "delete_volume" :: held 1.601s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Created reservations ['86a88593-581c-4d74-958e-1fb1e6d6be5e', 'd3696977-b661-4257-a650-6356c6954e21', '10a67d28-ea8a-40ac-b6bf-8f1250ca4854', '1fda388f-0c85-4659-a3ea-d7d235456758'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:47 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:48:47 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-aab5c84b-e634-44a6-92c1-a6b4a58a7815-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "cinder-aab5c84b-e634-44a6-92c1-a6b4a58a7815-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Acquiring lock "cinder-quobyte-aab5c84b-e634-44a6-92c1-a6b4a58a7815" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-aab5c84b-e634-44a6-92c1-a6b4a58a7815" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[825b6ea1-c7da-4c5d-8288-e1810066199f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:48 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815
Jun 29 04:48:48 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:48 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.116s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:48 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Deleted volume successfully.
Jun 29 04:48:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-af890171-2465-4448-a0b4-c634eb505a7c tempest-VolumesTestJSON-573921995 None] Lock "cinder-3058b0a5-0959-4626-bc47-b2e1dcab0177-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:49 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815" returned: 0 in 1.395s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:49 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815
Jun 29 04:48:49 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:50 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-aab5c84b-e634-44a6-92c1-a6b4a58a7815" returned: 0 in 1.120s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "cinder-quobyte-aab5c84b-e634-44a6-92c1-a6b4a58a7815" released by "delete_volume" :: held 2.607s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:50 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Created reservations ['9cd9d22b-f3c4-49ae-8034-9704ec749102', '30ff3c1f-ab51-4adb-86b7-b3f31dcd37df', '74bf2f12-9a12-49c8-8850-6d5ac3e87447', '27ee14ae-df5e-4f3c-b3fe-7097e0d6be7e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:51 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:48:51 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Flow 'volume_create_manager' (e030e5e0-1c36-4be4-9c7c-8fa59f20e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618e5147-f0fe-4c9e-803e-456248e9450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618e5147-f0fe-4c9e-803e-456248e9450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1130913040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b2054f-a263-4b78-93b6-2e94c47601db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5764b33a0cdd418980a86a6af8bb4122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:52Z,use_quota=True,user_id='e610bfb2768d47eaa75eed30480a2e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148efe8c-61fb-497a-9cd8-805ad147ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148efe8c-61fb-497a-9cd8-805ad147ad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98d3e19-8915-4435-97b2-969f1faef941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98d3e19-8915-4435-97b2-969f1faef941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b2054f-a263-4b78-93b6-2e94c47601db', 'volume_name': 'volume-47b2054f-a263-4b78-93b6-2e94c47601db', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6feb7a00-9723-4883-be76-5837fb0cabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6feb7a00-9723-4883-be76-5837fb0cabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6c942-6982-41a6-b45a-483201d49a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Volume 47b2054f-a263-4b78-93b6-2e94c47601db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b2054f-a263-4b78-93b6-2e94c47601db', 'volume_size': 1}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1130913040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b2054f-a263-4b78-93b6-2e94c47601db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5764b33a0cdd418980a86a6af8bb4122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:48:52Z,use_quota=True,user_id='e610bfb2768d47eaa75eed30480a2e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Creating volume 47b2054f-a263-4b78-93b6-2e94c47601db {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:48:52 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:52 devstack sudo[100558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db 1073741824
Jun 29 04:48:52 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:52 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.635s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:48:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Deleted volume successfully.
Jun 29 04:48:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f7f9030-cab4-4bff-8282-fce6888e2ea1 tempest-VolumesTestJSON-573921995 None] Lock "cinder-aab5c84b-e634-44a6-92c1-a6b4a58a7815-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:48:54 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db 1073741824" returned: 0 in 1.974s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:48:54 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db
Jun 29 04:48:54 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:48:55 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db" returned: 0 in 1.429s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] <== create_volume: return (3561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.569s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6c942-6982-41a6-b45a-483201d49a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b2054f-a263-4b78-93b6-2e94c47601db', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a94c9-c4d4-4f02-9cbb-d84180b0df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:48:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Volume volume-47b2054f-a263-4b78-93b6-2e94c47601db (47b2054f-a263-4b78-93b6-2e94c47601db): created successfully
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a94c9-c4d4-4f02-9cbb-d84180b0df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:48:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Flow 'volume_create_manager' (e030e5e0-1c36-4be4-9c7c-8fa59f20e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:48:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4755ad3c-251c-4d42-bae9-b91f9a1980f2 tempest-ServerRescueNegativeTestJSON-370128653 None] Created volume successfully.
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:03 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:49:03 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:04 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.347s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:49:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:49:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:49:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:49:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=40,cinder:UPDATE=55,cinder:DELETE=6,cinder:INSERT=6 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:49:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=49,cinder:INSERT=16,cinder:SELECT=38,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Flow 'volume_create_manager' (069b4094-c22e-4ec0-aa36-db9698c12a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc54ff-dffd-4e2a-a3ea-0bc40e702cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc54ff-dffd-4e2a-a3ea-0bc40e702cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-986428017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6766de-3046-4450-915a-633e1b164eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a42f8665044445852d002ae04a333d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:08Z,use_quota=True,user_id='72816f03133e4ead9c6390b14a3e737b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611c500f-5285-4e85-ae73-f1ff0ffdce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611c500f-5285-4e85-ae73-f1ff0ffdce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49de5bb-d284-492b-be4b-c61d9fd88541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49de5bb-d284-492b-be4b-c61d9fd88541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b6766de-3046-4450-915a-633e1b164eb1', 'volume_name': 'volume-2b6766de-3046-4450-915a-633e1b164eb1', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd8f869-6781-499c-816b-3a4288800797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd8f869-6781-499c-816b-3a4288800797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea7dd04-5884-4cad-b3eb-365cb225f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:08 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Volume 2b6766de-3046-4450-915a-633e1b164eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b6766de-3046-4450-915a-633e1b164eb1', 'volume_size': 1}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-986428017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6766de-3046-4450-915a-633e1b164eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a42f8665044445852d002ae04a333d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:08Z,use_quota=True,user_id='72816f03133e4ead9c6390b14a3e737b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Creating volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:49:08 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:49:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:08 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 1073741824
Jun 29 04:49:08 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:10 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 1073741824" returned: 0 in 2.120s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:10 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1
Jun 29 04:49:10 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:12 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1" returned: 0 in 1.820s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] <== create_volume: return (4056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.061s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea7dd04-5884-4cad-b3eb-365cb225f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6766de-3046-4450-915a-633e1b164eb1', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c21545-af55-4303-a471-fa0053cab33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Volume volume-2b6766de-3046-4450-915a-633e1b164eb1 (2b6766de-3046-4450-915a-633e1b164eb1): created successfully
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c21545-af55-4303-a471-fa0053cab33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Flow 'volume_create_manager' (069b4094-c22e-4ec0-aa36-db9698c12a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-67880a3c-6106-48bc-9efc-fc9557feeba7 tempest-SnapshotsActionsTest-758274476 None] Created volume successfully.
Jun 29 04:49:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Creating offline snapshot 0cf0e44c-a3b5-463c-99ab-0b34e87f09fd of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b59f1e-e96a-482a-ab53-1d50c035d584]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:13 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1
Jun 29 04:49:13 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:14 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1" returned: 0 in 1.249s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:14 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd 1G
Jun 29 04:49:14 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:16 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd 1G" returned: 0 in 1.612s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:16 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:16 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 1.004s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:17 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd is being set with open permissions: ugo+rw
Jun 29 04:49:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:17 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:17 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:17 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:18 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 1.379s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:18 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info
Jun 29 04:49:18 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:20 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info" returned: 0 in 1.397s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:20 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info is being set with open permissions: ugo+rw
Jun 29 04:49:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:20 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info
Jun 29 04:49:20 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:21 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.info" returned: 0 in 0.872s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.689s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-26c2fe41-e362-4ebb-a6de-f49d97f6048c tempest-SnapshotsActionsTest-758274476 None] Create snapshot completed successfully
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Acquiring lock "cinder-47b2054f-a263-4b78-93b6-2e94c47601db-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "cinder-47b2054f-a263-4b78-93b6-2e94c47601db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Acquiring lock "cinder-quobyte-47b2054f-a263-4b78-93b6-2e94c47601db" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "cinder-quobyte-47b2054f-a263-4b78-93b6-2e94c47601db" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3902c-713d-4d0d-8923-e5b93b6ab921]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:22 devstack sudo[101235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db
Jun 29 04:49:22 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Creating offline snapshot ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde18f1-3835-4b9c-b869-a323f8ecea14]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:22 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:22 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:23 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db" returned: 0 in 1.083s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:23 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db
Jun 29 04:49:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:23 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.901s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:23 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 1G
Jun 29 04:49:23 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:24 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-47b2054f-a263-4b78-93b6-2e94c47601db" returned: 0 in 0.940s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "cinder-quobyte-47b2054f-a263-4b78-93b6-2e94c47601db" released by "delete_volume" :: held 2.083s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Created reservations ['bbb00bcd-67a2-4a9b-8ecd-5dbf11ae53c2', '8e555f72-8740-4bc8-8318-a34af048d945', 'e2d442f7-71d3-4603-9b14-a5aaeb6ef62a', 'be1c7302-0f6d-4004-936a-8c7c0bff2a9a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:24 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:49:24 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:24 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 1G" returned: 0 in 0.982s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:24 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2
Jun 29 04:49:24 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:25 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:25 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:49:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Deleted volume successfully.
Jun 29 04:49:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f6dc7151-173c-4a6e-8efa-7d97fc3fe115 tempest-ServerRescueNegativeTestJSON-370128653 None] Lock "cinder-47b2054f-a263-4b78-93b6-2e94c47601db-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:25 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" returned: 0 in 0.819s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:25 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 is being set with open permissions: ugo+rw
Jun 29 04:49:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:25 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2
Jun 29 04:49:25 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:26 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" returned: 0 in 0.680s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.507s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b042c1e8-dd3f-48e9-ae3a-cf06b49a45ed tempest-SnapshotsActionsTest-758274476 None] Create snapshot completed successfully
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Deleting offline snapshot ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] snapshot_file for this snap is: volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[75932db8-78ce-4dbe-93ff-67a46b754a26]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:27 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2
Jun 29 04:49:27 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:28 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" returned: 0 in 0.798s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:28 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0c332-b0e4-4db5-aa34-8d16d836f10f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:28 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:28 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:29 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.968s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:29 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2
Jun 29 04:49:29 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:30 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" returned: 0 in 0.850s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:30 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2
Jun 29 04:49:30 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:30 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" returned: 0 in 0.658s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2" released by "_delete_snapshot" :: held 3.418s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_snapshot" :: held 3.442s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:30 devstack cinder-volume[93723]: WARNING cinder.quota [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Created reservations ['14c31fc2-c12a-4a45-a39d-f9ded08b5a53', '2c140b9b-884c-440d-807e-6bf828f15d3b', '9092853c-1df0-4e66-afc4-cf3987548317', '183180ef-bc12-4970-8e8f-a99140b192ea'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:49:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Delete snapshot completed successfully.
Jun 29 04:49:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-63fe50d8-2489-4b78-a1bc-95ebbb177f05 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-ed7b9333-1b7f-4685-a2ed-c264f95b6ac2-delete_snapshot" released by "delete_snapshot" :: held 3.654s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Creating offline snapshot da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:31 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82aa5d-35f4-47b9-9544-a7d575201ad7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:32 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:32 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:32 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.896s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:32 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 1G
Jun 29 04:49:32 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (a15cb6a6-38f5-42d5-b7a9-f27c0a8fb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dec541b-e564-4c9d-81c3-9a48e6b41cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dec541b-e564-4c9d-81c3-9a48e6b41cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830531469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac810e8a-f69b-450b-ae11-2149b394c603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:34Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fabba3-0591-4a19-a760-d35397f81aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fabba3-0591-4a19-a760-d35397f81aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52c36c1-67c4-402c-9f0f-e57caabd5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52c36c1-67c4-402c-9f0f-e57caabd5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac810e8a-f69b-450b-ae11-2149b394c603', 'volume_name': 'volume-ac810e8a-f69b-450b-ae11-2149b394c603', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79a9345-aa89-4deb-9d38-0a9822b35334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79a9345-aa89-4deb-9d38-0a9822b35334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bbc948-46ac-4277-a922-f4da94cd5bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Volume ac810e8a-f69b-450b-ae11-2149b394c603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac810e8a-f69b-450b-ae11-2149b394c603', 'volume_size': 1}
Jun 29 04:49:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:34 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 1G" returned: 0 in 1.137s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:34 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2
Jun 29 04:49:34 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:35 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" returned: 0 in 1.001s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:35 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 is being set with open permissions: ugo+rw
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:35 devstack sudo[101433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2
Jun 29 04:49:35 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (454296b7-8ad3-490d-8821-0d943410fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0716474-9eeb-4c64-b0fe-a0eef0b05762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0716474-9eeb-4c64-b0fe-a0eef0b05762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-236854721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f937ca-2ffd-43c3-9f8a-76695915a423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:35Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ac8c04-8256-41c5-ace0-fadc56903d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ac8c04-8256-41c5-ace0-fadc56903d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330da8d4-7402-4caa-8598-b885b7df3727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330da8d4-7402-4caa-8598-b885b7df3727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f937ca-2ffd-43c3-9f8a-76695915a423', 'volume_name': 'volume-45f937ca-2ffd-43c3-9f8a-76695915a423', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48eb9bb-f51e-4a09-93d5-508b30901768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48eb9bb-f51e-4a09-93d5-508b30901768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9209fe6a-0f55-4296-ac8a-70ed20c849f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:35 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Volume 45f937ca-2ffd-43c3-9f8a-76695915a423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f937ca-2ffd-43c3-9f8a-76695915a423', 'volume_size': 1}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:35 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" returned: 0 in 0.740s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.879s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830531469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac810e8a-f69b-450b-ae11-2149b394c603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c9c86ba73649308cbe0ec855b8ca83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:34Z,use_quota=True,user_id='21f5508735f14e02b87c770f8f40f59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Creating volume ac810e8a-f69b-450b-ae11-2149b394c603 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:49:35 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:49:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:35 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 1073741824
Jun 29 04:49:35 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:35 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-716a658d-ac52-42c8-81b8-d16102b93ef4 tempest-SnapshotsActionsTest-758274476 None] Create snapshot completed successfully
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Deleting offline snapshot da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] snapshot_file for this snap is: volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeda8bd-e3d3-4523-9869-70633b65847f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:36 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2
Jun 29 04:49:36 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:36 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 1073741824" returned: 0 in 0.955s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:36 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603
Jun 29 04:49:36 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:37 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6c825-c67c-47a4-aaa7-81ee8aea445e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:37 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:37 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:37 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603" returned: 0 in 0.684s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-236854721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f937ca-2ffd-43c3-9f8a-76695915a423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:35Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Creating volume 45f937ca-2ffd-43c3-9f8a-76695915a423 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:49:37 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:37 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 1073741824
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bbc948-46ac-4277-a922-f4da94cd5bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac810e8a-f69b-450b-ae11-2149b394c603', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:37 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a6679-9e4d-4f04-8922-a372b5bdddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Volume volume-ac810e8a-f69b-450b-ae11-2149b394c603 (ac810e8a-f69b-450b-ae11-2149b394c603): created successfully
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84a6679-9e4d-4f04-8922-a372b5bdddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Flow 'volume_create_manager' (a15cb6a6-38f5-42d5-b7a9-f27c0a8fb192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b569904e-9e6c-4242-b96d-40c391c03a99 tempest-AttachVolumeNegativeTest-1582855579 None] Created volume successfully.
Jun 29 04:49:38 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.806s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:38 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2
Jun 29 04:49:38 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:38 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 1073741824" returned: 0 in 0.963s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:38 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423
Jun 29 04:49:38 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:38 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" returned: 0 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:38 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2
Jun 29 04:49:38 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:39 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423" returned: 0 in 0.724s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9209fe6a-0f55-4296-ac8a-70ed20c849f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f937ca-2ffd-43c3-9f8a-76695915a423', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5490290-67e3-4507-b60e-0fe3960eff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Volume volume-45f937ca-2ffd-43c3-9f8a-76695915a423 (45f937ca-2ffd-43c3-9f8a-76695915a423): created successfully
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5490290-67e3-4507-b60e-0fe3960eff25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (454296b7-8ad3-490d-8821-0d943410fab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:39 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-439ff3aa-e394-4dc9-95e3-9d7c1a02c57d tempest-AttachVolumeTestJSON-595866368 None] Created volume successfully.
Jun 29 04:49:39 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2" released by "_delete_snapshot" :: held 3.300s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_snapshot" :: held 3.323s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Created reservations ['d79a82a3-fd7b-457c-8611-394e9159b8e4', 'dbca20ce-eee2-4a4f-9a37-201260f9923f', 'da1b0713-9ef5-41ee-a489-2c7fc099e4b7', 'b4f697a5-2cf8-4d25-9363-b245cbc0d698'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:49:39 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Delete snapshot completed successfully.
Jun 29 04:49:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-411be384-bc5c-4257-8d77-dacadb2c2c40 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-da5811d6-4f1e-4728-bf9a-2ea04d8d85a2-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Creating offline snapshot 3d18ee88-897d-4ba5-9f74-8232dbe389e8 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa382681-be3b-4ea9-b131-ec7dbf85c989]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:41 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:41 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:41 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.888s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:41 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 1G
Jun 29 04:49:41 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:42 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 1G" returned: 0 in 0.883s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:42 devstack sudo[101518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8
Jun 29 04:49:42 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:43 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8" returned: 0 in 0.782s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:43 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 is being set with open permissions: ugo+rw
Jun 29 04:49:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:43 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8
Jun 29 04:49:43 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:44 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8" returned: 0 in 0.703s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.249s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2839abe6-5000-43cf-b2e9-8d781c2bfad0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-73fa4dee-f42b-4475-88d6-889a39bf54a3 tempest-SnapshotsActionsTest-758274476 None] Create snapshot completed successfully
Jun 29 04:49:44 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603
Jun 29 04:49:44 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:45 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603" returned: 0 in 0.791s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.295s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2435b981-46ab-451f-aa49-73114a0e26d1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-ac810e8a-f69b-450b-ae11-2149b394c603', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '175fd0fa-a875-49b0-a236-47fc5d917c8a', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:49:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-1135f2fc-f190-4fe9-8834-09d0baa88c03 req-1518ab55-8649-4c94-a05f-aad63c54d9ab tempest-AttachVolumeNegativeTest-1582855579 None] attachment_update completed successfully.
Jun 29 04:49:45 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423
Jun 29 04:49:45 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-3d18ee88-897d-4ba5-9f74-8232dbe389e8-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-3d18ee88-897d-4ba5-9f74-8232dbe389e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-3d18ee88-897d-4ba5-9f74-8232dbe389e8" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-3d18ee88-897d-4ba5-9f74-8232dbe389e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Deleting offline snapshot 3d18ee88-897d-4ba5-9f74-8232dbe389e8 of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] snapshot_file for this snap is: volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d300fc8f-3baa-4ad6-89d5-f570bc07f1ff]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:46 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423" returned: 0 in 1.002s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.024s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-45f937ca-2ffd-43c3-9f8a-76695915a423', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce14e1f2-3eab-402d-ad6a-8198c577e2c6', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:49:46 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8
Jun 29 04:49:46 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-e2e9b1d5-158b-4e01-a8a8-0cfe2910d4ae req-e54a3840-bd42-47d6-ba3e-9b2698d2d074 tempest-AttachVolumeTestJSON-595866368 None] attachment_update completed successfully.
Jun 29 04:49:46 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8" returned: 0 in 0.873s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1208d53-8529-4756-8902-5725366720fe]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:47 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:47 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5731c2f1-4f2d-4163-b152-adba44ca9eb5 tempest-GroupSnapshotsV319Test-970970082 None] Group tempest-GroupSnapshotsV319Test-Group-1115053354: creating
Jun 29 04:49:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5731c2f1-4f2d-4163-b152-adba44ca9eb5 tempest-GroupSnapshotsV319Test-970970082 None] Group tempest-GroupSnapshotsV319Test-Group-1115053354: created successfully
Jun 29 04:49:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5731c2f1-4f2d-4163-b152-adba44ca9eb5 tempest-GroupSnapshotsV319Test-970970082 None] Create group completed successfully.
Jun 29 04:49:47 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.828s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:47 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8
Jun 29 04:49:47 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:48 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8" returned: 0 in 0.769s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:48 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8
Jun 29 04:49:48 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Flow 'volume_create_manager' (e8b30e5c-3311-49d4-955e-bc0942ef626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:49 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98d20ca-cfd8-4845-bbad-dac0c82e8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.3d18ee88-897d-4ba5-9f74-8232dbe389e8" returned: 0 in 0.686s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98d20ca-cfd8-4845-bbad-dac0c82e8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484808172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe488d24-a6d5-457b-b244-ffa9d4f00bef,host='devstack@QuobyteHD#QuobyteHD',id=2465586c-22ad-4805-b48d-7f21f41582a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3aead24be44ed87dd78a3c781e26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:49Z,use_quota=True,user_id='4e36df351c484c969a529a5a4f6ff2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1285053c-8b6e-413b-889c-4284426ed799),volume_type_id=1285053c-8b6e-413b-889c-4284426ed799)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5b516-1c7f-4753-9111-5e1761abeddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5b516-1c7f-4753-9111-5e1761abeddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d905b30e-2b65-4517-b250-b8f659dd2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d905b30e-2b65-4517-b250-b8f659dd2ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2465586c-22ad-4805-b48d-7f21f41582a0', 'volume_name': 'volume-2465586c-22ad-4805-b48d-7f21f41582a0', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d05847-48b6-46fc-a37f-5d164a0bacbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d05847-48b6-46fc-a37f-5d164a0bacbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc67cf-859d-4c5a-8b3c-b497757c54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:49 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Volume 2465586c-22ad-4805-b48d-7f21f41582a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2465586c-22ad-4805-b48d-7f21f41582a0', 'volume_size': 1}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fe488d24-a6d5-457b-b244-ffa9d4f00bef,created_at=2026-06-29T02:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484808172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe488d24-a6d5-457b-b244-ffa9d4f00bef,host='devstack@QuobyteHD#QuobyteHD',id=2465586c-22ad-4805-b48d-7f21f41582a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f3aead24be44ed87dd78a3c781e26f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:49Z,use_quota=True,user_id='4e36df351c484c969a529a5a4f6ff2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1285053c-8b6e-413b-889c-4284426ed799),volume_type_id=1285053c-8b6e-413b-889c-4284426ed799)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Creating volume 2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:49:49 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-3d18ee88-897d-4ba5-9f74-8232dbe389e8" released by "_delete_snapshot" :: held 3.330s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_snapshot" :: held 3.354s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:49 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 1073741824
Jun 29 04:49:49 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Created reservations ['2a2dbb31-c7b0-4575-8c68-02e4f88253dc', 'b55b5bf6-f16d-4cf3-aeea-20e52cdd4f60', '81f6391a-9f5c-47c6-9a6d-7912ed557dbc', '2da7668b-aa1e-4118-bf0c-42f0f94d5439'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:49:49 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Delete snapshot completed successfully.
Jun 29 04:49:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1a8c51a4-6f3e-40ab-a1e0-bf6416952294 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-3d18ee88-897d-4ba5-9f74-8232dbe389e8-delete_snapshot" released by "delete_snapshot" :: held 3.521s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:50 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 1073741824" returned: 0 in 1.002s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:50 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0
Jun 29 04:49:50 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (76552981-44b2-4765-9de0-fc800816c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09873ad9-73aa-4cbb-b0bd-755698df7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09873ad9-73aa-4cbb-b0bd-755698df7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1451132777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf26980-8b38-46d8-ba69-d653c5015f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:51Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a2d92b-a070-4ec5-802b-d14e3be40756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a2d92b-a070-4ec5-802b-d14e3be40756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa099ab0-827f-4d46-90d9-a59116e2be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa099ab0-827f-4d46-90d9-a59116e2be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf26980-8b38-46d8-ba69-d653c5015f87', 'volume_name': 'volume-adf26980-8b38-46d8-ba69-d653c5015f87', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857cb1ce-9a3c-4c80-9dd4-e6dd05aaefc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857cb1ce-9a3c-4c80-9dd4-e6dd05aaefc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d79813-32e1-4745-ad44-26eb96989fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Volume adf26980-8b38-46d8-ba69-d653c5015f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf26980-8b38-46d8-ba69-d653c5015f87', 'volume_size': 1}
Jun 29 04:49:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:51 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0" returned: 0 in 0.721s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.541s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Creating offline snapshot f55c29c7-cfc6-4aa8-8645-61490bc0518a of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc67cf-859d-4c5a-8b3c-b497757c54c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2465586c-22ad-4805-b48d-7f21f41582a0', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3296801a-d36e-46df-a1ca-7a33e204166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[31515799-556b-465a-8726-b59b78c8675f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:51 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Volume volume-2465586c-22ad-4805-b48d-7f21f41582a0 (2465586c-22ad-4805-b48d-7f21f41582a0): created successfully
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3296801a-d36e-46df-a1ca-7a33e204166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Flow 'volume_create_manager' (e8b30e5c-3311-49d4-955e-bc0942ef626b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-58de7c9f-d4cf-475e-bc16-5fb7e51796d5 tempest-GroupSnapshotsV319Test-970970082 None] Created volume successfully.
Jun 29 04:49:51 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:51 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:51 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.761s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:51 devstack sudo[101983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a 1G
Jun 29 04:49:51 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] GroupSnapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: creating.
Jun 29 04:49:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Group snapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: creating. {{(pid=93723) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 29 04:49:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-8145fd27-4de7-4493-a589-cb4334f9415b req-2c4f9eea-281b-4ece-885a-e4b07c3c1972 tempest-AttachVolumeNegativeTest-1582855579 None] Terminate volume connection completed successfully.
Jun 29 04:49:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-8145fd27-4de7-4493-a589-cb4334f9415b req-2c4f9eea-281b-4ece-885a-e4b07c3c1972 tempest-AttachVolumeNegativeTest-1582855579 None] Deleting attachment 175fd0fa-a875-49b0-a236-47fc5d917c8a. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:49:52 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a 1G" returned: 0 in 0.829s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:52 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a
Jun 29 04:49:52 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:53 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a" returned: 0 in 0.694s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:53 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a is being set with open permissions: ugo+rw
Jun 29 04:49:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:53 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a
Jun 29 04:49:53 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:54 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a" returned: 0 in 0.676s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.063s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.193s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1451132777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf26980-8b38-46d8-ba69-d653c5015f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c033b4761d4182a3c30744da97b0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:49:51Z,use_quota=True,user_id='968623d0659d461fa0f5ae497cb61269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Creating volume adf26980-8b38-46d8-ba69-d653c5015f87 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:49:54 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:54 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 1073741824
Jun 29 04:49:54 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:54 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-60f68c78-1f7c-470b-b818-206dc79cfb4f tempest-SnapshotsActionsTest-758274476 None] Create snapshot completed successfully
Jun 29 04:49:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-f55c29c7-cfc6-4aa8-8645-61490bc0518a-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-f55c29c7-cfc6-4aa8-8645-61490bc0518a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Acquiring lock "cinder-quobyte-f55c29c7-cfc6-4aa8-8645-61490bc0518a" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:55 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 1073741824" returned: 0 in 0.876s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-f55c29c7-cfc6-4aa8-8645-61490bc0518a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Deleting offline snapshot f55c29c7-cfc6-4aa8-8645-61490bc0518a of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] snapshot_file for this snap is: volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b804b7-4fb2-4545-b9b7-117915eae87c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:55 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87
Jun 29 04:49:55 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:55 devstack sudo[102008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a
Jun 29 04:49:55 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:56 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.908s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d79813-32e1-4745-ad44-26eb96989fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf26980-8b38-46d8-ba69-d653c5015f87', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3146651-901f-4934-9683-9bad97550430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:49:56 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Creating offline snapshot a07715c7-1492-49fe-91f0-b3dfbac4b3e0 of volume 2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a" returned: 0 in 1.003s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e009169-b426-4031-82c3-fe7ef80ec579]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c4f79-a272-4207-b21c-5545669ce846]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Volume volume-adf26980-8b38-46d8-ba69-d653c5015f87 (adf26980-8b38-46d8-ba69-d653c5015f87): created successfully
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3146651-901f-4934-9683-9bad97550430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Flow 'volume_create_manager' (76552981-44b2-4765-9de0-fc800816c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:49:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-88930058-e16a-49d0-b2c7-b0ac8588247b tempest-AttachVolumeTestJSON-595866368 None] Created volume successfully.
Jun 29 04:49:56 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0
Jun 29 04:49:56 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:56 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:56 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:56 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0" returned: 0 in 0.885s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:57 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:57 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 1G
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:57 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:57 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a
Jun 29 04:49:57 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:57 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a" returned: 0 in 0.893s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:57 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a
Jun 29 04:49:57 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 1G" returned: 0 in 0.966s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:57 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2465586c-22ad-4805-b48d-7f21f41582a0 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:58 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2465586c-22ad-4805-b48d-7f21f41582a0 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0
Jun 29 04:49:58 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:58 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.f55c29c7-cfc6-4aa8-8645-61490bc0518a" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-f55c29c7-cfc6-4aa8-8645-61490bc0518a" released by "_delete_snapshot" :: held 3.600s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_snapshot" :: held 3.628s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Created reservations ['560d4177-98fa-4f31-b81f-5b62bddcc5cd', '96d589d7-12d4-4439-8aaa-37b4f38112e5', '7881716c-3296-4cf2-bf3e-053a4c42ad8d', 'c67871a9-07d5-4816-827a-60a495a694f0'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:49:58 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2465586c-22ad-4805-b48d-7f21f41582a0 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0" returned: 0 in 0.780s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:58 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:58 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0
Jun 29 04:49:58 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Delete snapshot completed successfully.
Jun 29 04:49:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7c7dda14-093b-4b9b-b0ad-2f0595a6a545 tempest-SnapshotsActionsTest-535984603 None] Lock "cinder-f55c29c7-cfc6-4aa8-8645-61490bc0518a-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:49:59 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0" returned: 0 in 0.638s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:59 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info
Jun 29 04:49:59 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "cinder-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "cinder-quobyte-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Deleting offline snapshot 0cf0e44c-a3b5-463c-99ab-0b34e87f09fd of volume 2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] snapshot_file for this snap is: volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915f5e0-2ab8-48a6-a400-6e3961c7f133]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:49:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:49:59 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:49:59 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:00 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info" returned: 0 in 0.798s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:00 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:00 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info
Jun 29 04:50:00 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:00 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.820s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b6766de-3046-4450-915a-633e1b164eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98510b1-54da-49f0-bec8-cdf0638720e7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:00 devstack sudo[102121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1
Jun 29 04:50:00 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:00 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.info" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.251s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd8453-2f93-45be-a33e-6564dbcf04fa]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-835d971b-c885-48e5-b51c-67038b38a48e tempest-GroupSnapshotsV319Test-970970082 None] group_snapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: created successfully
Jun 29 04:50:01 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87
Jun 29 04:50:01 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:01 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1" returned: 0 in 0.837s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:01 devstack sudo[102129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:50:01 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:01 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87" returned: 0 in 0.818s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-adf26980-8b38-46d8-ba69-d653c5015f87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43900584-2f4a-4b2c-9dc0-a72b14a2a9fc', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:50:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-87d43215-62a1-4ac5-9ee1-1a26c6118e0d req-d3399013-8720-4e1c-bc3c-af4a00aaed2d tempest-AttachVolumeTestJSON-595866368 None] attachment_update completed successfully.
Jun 29 04:50:02 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] group_snapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: deleting
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] group_snapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: deleting {{(pid=93723) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "cinder-quobyte-a07715c7-1492-49fe-91f0-b3dfbac4b3e0" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-a07715c7-1492-49fe-91f0-b3dfbac4b3e0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Deleting offline snapshot a07715c7-1492-49fe-91f0-b3dfbac4b3e0 of volume 2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] snapshot_file for this snap is: volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9770147-aaaa-498e-9f1e-251bb1cfffa5]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:02 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0
Jun 29 04:50:02 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:02 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.954s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:02 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd
Jun 29 04:50:02 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:03 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0" returned: 0 in 0.993s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2465586c-22ad-4805-b48d-7f21f41582a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc1513-7baf-4364-ba37-e62825b8f6ab]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:03 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1.0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" returned: 0 in 0.762s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-ac810e8a-f69b-450b-ae11-2149b394c603-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-ac810e8a-f69b-450b-ae11-2149b394c603-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd" released by "_delete_snapshot" :: held 3.568s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_snapshot" :: held 3.610s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:03 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0
Jun 29 04:50:03 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-quobyte-ac810e8a-f69b-450b-ae11-2149b394c603" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-ac810e8a-f69b-450b-ae11-2149b394c603" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ba06e-a7d2-4815-a372-380ec1f7c728]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Created reservations ['ec09f3c1-2764-4faa-a9ec-c18a0d244721', 'bad71c43-b81f-479a-95da-20eee50e546b', '95aeb5d1-fa38-4549-8922-a63a63e51788', '9b1fb2ef-8134-4674-9dfc-26b93cf96bef'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:03 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:03 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:03 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Delete snapshot completed successfully.
Jun 29 04:50:03 devstack sudo[102193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603
Jun 29 04:50:03 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7071adcb-0980-4751-84f8-df67207325c9 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-0cf0e44c-a3b5-463c-99ab-0b34e87f09fd-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "cinder-2b6766de-3046-4450-915a-633e1b164eb1-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-2b6766de-3046-4450-915a-633e1b164eb1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:04 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0" returned: 0 in 0.907s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" acquired by "delete_volume" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:04 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0
Jun 29 04:50:04 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7308545e-24f9-455d-8f2a-cfb5055ea9e3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:04 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603" returned: 0 in 0.856s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:04 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:04 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1
Jun 29 04:50:04 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.846s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:50:04 devstack sudo[102208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603
Jun 29 04:50:04 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:04 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:04 devstack sudo[102218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0
Jun 29 04:50:04 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:04 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac810e8a-f69b-450b-ae11-2149b394c603" returned: 0 in 0.697s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-ac810e8a-f69b-450b-ae11-2149b394c603" released by "delete_volume" :: held 1.607s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:05 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1" returned: 0 in 0.870s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:05 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1
Jun 29 04:50:05 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Created reservations ['e23397fc-70c6-4e64-a7ed-07adfe8014eb', '71854b85-466b-45ca-8d59-91e27603b597', '0adcf18a-b685-467b-8423-c4f1bf9cae81', 'dee7eae5-1937-4cc3-93f0-72f2fedae68f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:05 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:05 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:05 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0.a07715c7-1492-49fe-91f0-b3dfbac4b3e0" returned: 0 in 0.742s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-a07715c7-1492-49fe-91f0-b3dfbac4b3e0" released by "_delete_snapshot" :: held 3.677s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:05 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" released by "delete_snapshot" :: held 3.706s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b6766de-3046-4450-915a-633e1b164eb1" returned: 0 in 0.747s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-quobyte-2b6766de-3046-4450-915a-633e1b164eb1" released by "delete_volume" :: held 1.693s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=89,cinder:UPDATE=72,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=83,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=7 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-quobyte-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:05 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.792s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3d4c0-70f5-4e34-ae69-fdce24a4c2e0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Deleted volume successfully.
Jun 29 04:50:06 devstack cinder-volume[93723]: WARNING cinder.quota [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2045917033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2045917033, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:06 devstack cinder-volume[93723]: WARNING cinder.quota [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2045917033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2045917033, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-620cdf08-4e28-464d-8368-2c5d41655bce tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-ac810e8a-f69b-450b-ae11-2149b394c603-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] Created reservations ['43db3bde-5ab0-41b9-a54c-3c1a2730101d', '76f37134-fc76-4062-b8dc-a0fca3e079eb', '14d8edc8-5a55-48ab-8841-87f9336e079f', '4d837179-89e4-4739-a70e-66f864e90d4d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Created reservations ['e907d4e9-e7a4-40f2-a656-2427d495eafe', '6ce2f492-0449-4817-92ec-a8ee5977fe28', 'bf3e8d44-db69-4274-b006-74be62d9bacd', '5789cdd8-d775-47c2-b42f-ec3c530fbafa'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:06 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb
Jun 29 04:50:06 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:06 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c7931bf4-ff67-4d22-9405-e7e19af45909 tempest-GroupSnapshotsV319Test-970970082 None] group_snapshot 8f615755-c1fd-44c4-83c7-a7c938906b2e: deleted successfully
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:06 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:06 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:06 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:06 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Deleted volume successfully.
Jun 29 04:50:06 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" returned: 0 in 0.962s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-81c44956-55b6-4c06-b651-a3100dd44604 tempest-SnapshotsActionsTest-758274476 None] Lock "cinder-2b6766de-3046-4450-915a-633e1b164eb1-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:06 devstack sudo[102262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb
Jun 29 04:50:06 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd53508-95e8-4afe-8ae8-74c26a621579]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:07 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0
Jun 29 04:50:07 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:07 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" returned: 0 in 0.896s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb" released by "delete_volume" :: held 1.919s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Created reservations ['b62d510d-1c49-44db-89e2-5de7557a3eb8', 'cd206b9e-5891-447c-ac04-e58b0ee67ad1', 'cdf8f7bb-3189-4bf2-8a9c-d7fd38849ff2', 'bf04a9ae-5901-4eb0-be30-14fc487be5e4'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:08 devstack sudo[102270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:08 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:08 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0" returned: 0 in 0.916s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:08 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0
Jun 29 04:50:08 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:08 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.743s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Deleted volume successfully.
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-84415482-8964-4079-a481-fbb7c385f1aa tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-ed311c36-ff3e-4cfb-94df-fb8e0841e1cb-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-1e0bac5e-8f46-45a9-8a67-3630027c11a0 req-3dbcd49c-6f4a-4b1d-9443-0cb26c7ee249 tempest-AttachVolumeTestJSON-595866368 None] Terminate volume connection completed successfully.
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-1e0bac5e-8f46-45a9-8a67-3630027c11a0 req-3dbcd49c-6f4a-4b1d-9443-0cb26c7ee249 tempest-AttachVolumeTestJSON-595866368 None] Deleting attachment ce14e1f2-3eab-402d-ad6a-8198c577e2c6. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:50:08 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2465586c-22ad-4805-b48d-7f21f41582a0" returned: 0 in 0.895s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Lock "cinder-quobyte-2465586c-22ad-4805-b48d-7f21f41582a0" released by "delete_volume" :: held 1.893s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Created reservations ['98dcab74-7b3a-4324-9efa-8e00b52829a4'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:09 devstack cinder-volume[93723]: WARNING cinder.quota [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2045917033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2045917033, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Created reservations ['d17d9fc9-e24c-4736-ae5c-9d44f5befdcc', 'e3b2f040-b5dd-497b-8440-7f14512cf7b4', '945cf055-f7e2-43ef-a6f8-da123c5efdb5', '64ca044f-884f-4383-afe1-dc136f6a358a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:09 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:09 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-8e12584c-12a4-4425-8314-2df4b15a3b0c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-8e12584c-12a4-4425-8314-2df4b15a3b0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "cinder-quobyte-8e12584c-12a4-4425-8314-2df4b15a3b0c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-8e12584c-12a4-4425-8314-2df4b15a3b0c" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6e9a3-d6c3-4f0b-8183-5fdf658c78e7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:10 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.792s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:10 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9a240889-411e-4271-84bd-fd03978f94ce tempest-GroupSnapshotsV319Test-970970082 None] Delete group completed successfully.
Jun 29 04:50:10 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c
Jun 29 04:50:10 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:10 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c" returned: 0 in 0.907s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:10 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c
Jun 29 04:50:10 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:11 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e12584c-12a4-4425-8314-2df4b15a3b0c" returned: 0 in 0.981s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-quobyte-8e12584c-12a4-4425-8314-2df4b15a3b0c" released by "delete_volume" :: held 1.968s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-420b96f6-7863-4eca-aa7e-5f47119cffec req-c2ee20a2-bcf7-491f-b12d-5020003a1085 tempest-AttachVolumeTestJSON-595866368 None] Terminate volume connection completed successfully.
Jun 29 04:50:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-420b96f6-7863-4eca-aa7e-5f47119cffec req-c2ee20a2-bcf7-491f-b12d-5020003a1085 tempest-AttachVolumeTestJSON-595866368 None] Deleting attachment 43900584-2f4a-4b2c-9dc0-a72b14a2a9fc. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:50:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Created reservations ['04e7478c-5f73-4cd8-97f1-bf516532272c', '33990f93-e991-403f-8004-371da2d69e97', '046af025-3ae6-4122-9121-523ad1b3946a', '625bd63a-07c0-4b5a-bfd3-4a78241ab1c3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:12 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:12 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:12 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.875s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Deleted volume successfully.
Jun 29 04:50:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-28650ab4-5fec-4593-8b24-1e80c691052f tempest-AttachVolumeNegativeTest-1582855579 None] Lock "cinder-8e12584c-12a4-4425-8314-2df4b15a3b0c-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eaf90c62-411e-4d82-8113-25c40722c229 tempest-GroupsV314Test-1958600473 None] Group tempest-GroupsV314Test-Group-292193701: creating
Jun 29 04:50:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eaf90c62-411e-4d82-8113-25c40722c229 tempest-GroupsV314Test-1958600473 None] Group tempest-GroupsV314Test-Group-292193701: created successfully
Jun 29 04:50:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eaf90c62-411e-4d82-8113-25c40722c229 tempest-GroupsV314Test-1958600473 None] Create group completed successfully.
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Flow 'volume_create_manager' (aaeb682c-4232-40d2-ac0e-6e7145b2aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36d3970-f8a3-4634-9e99-697cc59e49b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36d3970-f8a3-4634-9e99-697cc59e49b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392161910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3af3eed6-0f50-4d9d-8c3d-358cd27effd2,host='devstack@QuobyteHD#QuobyteHD',id=30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8adecc4ca47c4f0598934a8591c0f442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:19Z,use_quota=True,user_id='fe80be7ad38143d18bd68d4fa16798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2551b011-98ff-4e4c-8832-43cf6d450baf),volume_type_id=2551b011-98ff-4e4c-8832-43cf6d450baf)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79135b27-db97-41d7-9dbf-13060bb2ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79135b27-db97-41d7-9dbf-13060bb2ce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d69a9-73f2-4c49-a69c-a5ac82368f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d69a9-73f2-4c49-a69c-a5ac82368f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8', 'volume_name': 'volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db5cbae-ab74-4b55-9161-f68e59877a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db5cbae-ab74-4b55-9161-f68e59877a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b5c71-d39d-4d17-badd-64e4a475546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:19 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Volume 30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8', 'volume_size': 1}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3af3eed6-0f50-4d9d-8c3d-358cd27effd2,created_at=2026-06-29T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392161910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3af3eed6-0f50-4d9d-8c3d-358cd27effd2,host='devstack@QuobyteHD#QuobyteHD',id=30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8adecc4ca47c4f0598934a8591c0f442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:19Z,use_quota=True,user_id='fe80be7ad38143d18bd68d4fa16798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2551b011-98ff-4e4c-8832-43cf6d450baf),volume_type_id=2551b011-98ff-4e4c-8832-43cf6d450baf)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Creating volume 30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:50:19 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:50:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:19 devstack sudo[102346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 1073741824
Jun 29 04:50:19 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:20 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 1073741824" returned: 0 in 1.117s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:20 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:20 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:21 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 0.766s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b5c71-d39d-4d17-badd-64e4a475546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87d4e4b-a5f3-407c-a238-c87ccbdb7277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:21 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Volume volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 (30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8): created successfully
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87d4e4b-a5f3-407c-a238-c87ccbdb7277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Flow 'volume_create_manager' (aaeb682c-4232-40d2-ac0e-6e7145b2aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dfeedbf7-4c1d-41b8-9ae0-723033a6de2c tempest-GroupsV314Test-1958600473 None] Created volume successfully.
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Flow 'volume_create_manager' (b64629be-c507-4ce2-892b-674b6850c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a204691-0802-49fa-a096-86385443bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a204691-0802-49fa-a096-86385443bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-254014666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c2e0bf-9aa4-40f9-90d2-04a14da0f55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66bde7260d495cb8fbd264710d3164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:23Z,use_quota=True,user_id='78a64d36be844609bc92630b8570a8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb73d5a-8d8a-4449-aba8-1df966f29fef),volume_type_id=9fb73d5a-8d8a-4449-aba8-1df966f29fef)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8554f-b7a7-467b-907f-c537dec2e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8554f-b7a7-467b-907f-c537dec2e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28b397-37b1-48da-87d1-52b82c8495df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28b397-37b1-48da-87d1-52b82c8495df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c2e0bf-9aa4-40f9-90d2-04a14da0f55e', 'volume_name': 'volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6f716c-6dea-464e-99ba-039bdc2ba806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6f716c-6dea-464e-99ba-039bdc2ba806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d707dacf-3888-4d0e-9dea-cbec6928ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:22 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Volume 54c2e0bf-9aa4-40f9-90d2-04a14da0f55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e', 'volume_size': 1}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-254014666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c2e0bf-9aa4-40f9-90d2-04a14da0f55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66bde7260d495cb8fbd264710d3164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:23Z,use_quota=True,user_id='78a64d36be844609bc92630b8570a8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb73d5a-8d8a-4449-aba8-1df966f29fef),volume_type_id=9fb73d5a-8d8a-4449-aba8-1df966f29fef)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Creating volume 54c2e0bf-9aa4-40f9-90d2-04a14da0f55e {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:50:22 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:50:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:23 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e 1073741824
Jun 29 04:50:23 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb9b23e8-a7fb-47f6-a647-8451ffed4309 tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-628411281: creating
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb9b23e8-a7fb-47f6-a647-8451ffed4309 tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-628411281: created successfully
Jun 29 04:50:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb9b23e8-a7fb-47f6-a647-8451ffed4309 tempest-GroupSnapshotsTest-1977655564 None] Create group completed successfully.
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-adf26980-8b38-46d8-ba69-d653c5015f87-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-adf26980-8b38-46d8-ba69-d653c5015f87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-quobyte-adf26980-8b38-46d8-ba69-d653c5015f87" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-adf26980-8b38-46d8-ba69-d653c5015f87" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff1672-53da-4112-bf21-fb5cff67df34]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:23 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87
Jun 29 04:50:23 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:23 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e 1073741824" returned: 0 in 0.903s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:23 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e
Jun 29 04:50:23 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:24 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87" returned: 0 in 0.830s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:24 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87
Jun 29 04:50:24 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:24 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" returned: 0 in 0.738s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.567s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:24 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Cloning volume 30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 to volume 88ebb25f-9b72-4e50-a389-8d2f0e21db24
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d707dacf-3888-4d0e-9dea-cbec6928ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f654c4-d8ac-47be-93fc-8ed5c8fbbee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Creating offline snapshot b83e8c8c-a547-4b56-887e-0081b357cdd5 of volume 30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:50:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Volume volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e (54c2e0bf-9aa4-40f9-90d2-04a14da0f55e): created successfully
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f654c4-d8ac-47be-93fc-8ed5c8fbbee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Flow 'volume_create_manager' (b64629be-c507-4ce2-892b-674b6850c220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[53152e4c-02d1-4a4e-a77b-45ca940a223c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (b2d9f604-795f-41a8-a2bf-099925b78eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a466592-cb72-481f-942a-374a12c29410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-57d43ac0-31b8-47e9-a6f3-4f47eff9bf3b tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Created volume successfully.
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a466592-cb72-481f-942a-374a12c29410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864234939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a67d9e85-8139-409d-a3b9-34fa706081c8,host='devstack@QuobyteHD#QuobyteHD',id=343d845f-e32e-40b4-a4a9-ee486adc836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:25Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55330661-d4ac-4b6b-9110-06e77bb7598a),volume_type_id=55330661-d4ac-4b6b-9110-06e77bb7598a)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a75dfb6-40cf-4b4f-8c49-8a7655a2a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a75dfb6-40cf-4b4f-8c49-8a7655a2a06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b498c9-d36f-4476-9ac3-f4af0f7c2b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b498c9-d36f-4476-9ac3-f4af0f7c2b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343d845f-e32e-40b4-a4a9-ee486adc836c', 'volume_name': 'volume-343d845f-e32e-40b4-a4a9-ee486adc836c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703786cf-fba0-4710-8c1f-ba82352b59ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703786cf-fba0-4710-8c1f-ba82352b59ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b205075b-d957-4357-94e1-03c1eb83b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:24 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:24 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Volume 343d845f-e32e-40b4-a4a9-ee486adc836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343d845f-e32e-40b4-a4a9-ee486adc836c', 'volume_size': 1}
Jun 29 04:50:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:25 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-adf26980-8b38-46d8-ba69-d653c5015f87" returned: 0 in 0.770s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-adf26980-8b38-46d8-ba69-d653c5015f87" released by "delete_volume" :: held 1.653s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Created reservations ['df1ddc94-e8bc-443d-aa67-5d5cd538a663', '6530df68-5423-41b2-8c9d-fb5010f0b03c', '526d2f4e-626c-4dee-a9d7-78dcb57719f1', '8081a556-d963-497d-833f-3d625f9b05bb'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:25 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:25 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:25 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:25 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:25 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 0.815s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:25 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 1G
Jun 29 04:50:25 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-45f937ca-2ffd-43c3-9f8a-76695915a423-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-45f937ca-2ffd-43c3-9f8a-76695915a423-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-quobyte-45f937ca-2ffd-43c3-9f8a-76695915a423" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-45f937ca-2ffd-43c3-9f8a-76695915a423" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[928edb2e-0a91-42d6-8f3d-81eb26ca6bac]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:26 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.781s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Deleted volume successfully.
Jun 29 04:50:26 devstack sudo[102385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423
Jun 29 04:50:26 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-490b7f52-6ae7-4969-9b51-1366001b9359 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-adf26980-8b38-46d8-ba69-d653c5015f87-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:26 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.857s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1242d0f3-174d-4bd4-a511-906e8e11d604 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Retype volume completed successfully.
Jun 29 04:50:26 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 1G" returned: 0 in 0.930s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:26 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:26 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:26 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423" returned: 0 in 0.802s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:26 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423
Jun 29 04:50:26 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "cinder-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "cinder-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "cinder-quobyte-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "cinder-quobyte-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[63109b10-c4d0-4a80-9125-3f826f1aec5f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:27 devstack sudo[102398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e
Jun 29 04:50:27 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:27 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:27 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:27 devstack sudo[102404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:27 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:27 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f937ca-2ffd-43c3-9f8a-76695915a423" returned: 0 in 0.753s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-45f937ca-2ffd-43c3-9f8a-76695915a423" released by "delete_volume" :: held 1.615s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Created reservations ['3bda57c3-dfa0-457e-b99a-59c4d3a49324', '576a20ef-431b-4dd8-9796-172810a06f4d', '5aef39bd-0ec3-4b18-b9d9-4c1f514ed7fd', 'c053907b-90e7-471b-8e81-772f48f5335d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:27 devstack sudo[102410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:27 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:27 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" returned: 0 in 0.800s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:27 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e
Jun 29 04:50:27 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:28 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:28 devstack sudo[102415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info
Jun 29 04:50:28 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-1eb7e23e-eab4-4982-8aae-fd9de3c857c2-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-1eb7e23e-eab4-4982-8aae-fd9de3c857c2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "cinder-quobyte-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494ef2d-753a-411f-bf99-a084e80b3ef2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:28 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.775s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:28 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" returned: 0 in 0.694s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Deleted volume successfully.
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "cinder-quobyte-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e" released by "delete_volume" :: held 1.553s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d99927-99eb-4615-8569-1d111493f1a3 tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-45f937ca-2ffd-43c3-9f8a-76695915a423-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:28 devstack cinder-volume[93723]: WARNING cinder.quota [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:28 devstack cinder-volume[93723]: WARNING cinder.quota [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Created reservations ['1b4fa927-eb63-4245-aa3f-4d9e737f9103', '58066958-2f4f-43cf-81ee-890262807602', 'e94b658d-dbb2-40de-94ee-351c3e05f539', 'd83f5b60-4d94-42d3-ae68-664e71b10063'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:28 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2
Jun 29 04:50:28 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:28 devstack sudo[102421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:28 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:28 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info" returned: 0 in 0.822s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:28 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:28 devstack sudo[102424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info
Jun 29 04:50:28 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:29 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.688s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:29 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Deleted volume successfully.
Jun 29 04:50:29 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" returned: 0 in 0.901s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3fce4aa1-1fbc-4007-a3fd-5db8d4dfe323 tempest-VolumeRetypeWithoutMigrationTest-643637248 None] Lock "cinder-54c2e0bf-9aa4-40f9-90d2-04a14da0f55e-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:29 devstack sudo[102430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2
Jun 29 04:50:29 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:29 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.info" returned: 0 in 0.830s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Acquiring lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] snapshot: b83e8c8c-a547-4b56-887e-0081b357cdd5, volume: 88ebb25f-9b72-4e50-a389-8d2f0e21db24,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb42bd5-4ffa-43e6-bfc9-862ecd66e1a0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:29 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:29 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:30 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" returned: 0 in 0.786s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-quobyte-1eb7e23e-eab4-4982-8aae-fd9de3c857c2" released by "delete_volume" :: held 1.741s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Created reservations ['22afc8e8-2072-48e5-91d7-9745ca6196d2', '024910b2-2b07-4681-b3e0-6d5120bef682', '6fcb8f8c-25ed-446f-a882-011c9b27f3fc', '26f74a4e-f2e8-49b9-ae6c-8fea9e714e66'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:30 devstack sudo[102436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:30 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:30 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.954s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f23ef2-a5e3-4183-8b8d-438be997eb4a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:30 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:30 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:31 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.782s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Deleted volume successfully.
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-467696ee-e98d-45bd-9c55-d846c5bc174b tempest-AttachVolumeTestJSON-595866368 None] Lock "cinder-1eb7e23e-eab4-4982-8aae-fd9de3c857c2-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:31 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 0.987s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:50:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:31 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24
Jun 29 04:50:31 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:38 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24" returned: 0 in 6.663s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516298e-3181-47e3-a6be-62951a30089d]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:38 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:38 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:39 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 1.098s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:39 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:50:39 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Converted 1024.00 MB image at 153.62 MB/s
Jun 29 04:50:39 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:39 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24
Jun 29 04:50:39 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:DELETE=6,cinder:SELECT=65,cinder:INSERT=18,cinder:UPDATE=83 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:50:40 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" released by "_copy_volume_from_snapshot" :: held 10.557s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Acquiring lock "cinder-quobyte-b83e8c8c-a547-4b56-887e-0081b357cdd5" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-b83e8c8c-a547-4b56-887e-0081b357cdd5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Deleting offline snapshot b83e8c8c-a547-4b56-887e-0081b357cdd5 of volume 30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] snapshot_file for this snap is: volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2370128-c16b-4bb1-b90d-8064a2fa1d44]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:40 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:40 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:41 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=73,cinder:INSERT=23,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:50:41 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.818s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec0ab26-7868-4aad-baf8-1b380b8ded24]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:41 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:41 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:42 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 0.847s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:42 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:42 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Flow 'volume_create_manager' (b9862136-f3e3-44ff-b2d3-3442db78d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c3160-fb8a-4af5-836c-904ff139b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c3160-fb8a-4af5-836c-904ff139b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1105791307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b07c9-5d88-480d-aecb-37e1f990f820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3dae14f1ae490ca5e48219687b0a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:42Z,use_quota=True,user_id='f96128a90a5d49ab8e278e4194ab3c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35300b84-b978-4963-bbf2-2f668c32d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35300b84-b978-4963-bbf2-2f668c32d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60988be8-84a0-476d-8cd0-01bd042d1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60988be8-84a0-476d-8cd0-01bd042d1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8b07c9-5d88-480d-aecb-37e1f990f820', 'volume_name': 'volume-5f8b07c9-5d88-480d-aecb-37e1f990f820', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736cb9c-a100-43ef-b56f-1cbbb09440c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736cb9c-a100-43ef-b56f-1cbbb09440c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc874f6-0481-44e4-b11e-c8db7810ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:42 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Volume 5f8b07c9-5d88-480d-aecb-37e1f990f820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8b07c9-5d88-480d-aecb-37e1f990f820', 'volume_size': 1}
Jun 29 04:50:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:43 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.859s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:43 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5
Jun 29 04:50:43 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:43 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8.b83e8c8c-a547-4b56-887e-0081b357cdd5" returned: 0 in 0.643s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-b83e8c8c-a547-4b56-887e-0081b357cdd5" released by "_delete_snapshot" :: held 3.280s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.037s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.801s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a67d9e85-8139-409d-a3b9-34fa706081c8,created_at=2026-06-29T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864234939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a67d9e85-8139-409d-a3b9-34fa706081c8,host='devstack@QuobyteHD#QuobyteHD',id=343d845f-e32e-40b4-a4a9-ee486adc836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:25Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55330661-d4ac-4b6b-9110-06e77bb7598a),volume_type_id=55330661-d4ac-4b6b-9110-06e77bb7598a)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Creating volume 343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:50:43 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:50:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:43 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c 1073741824
Jun 29 04:50:43 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-91d8ef4d-82a8-44d6-bc94-a8efcbc8d340 tempest-GroupsV314Test-1958600473 None] Create group from source-group-3af3eed6-0f50-4d9d-8c3d-358cd27effd2 completed successfully.
Jun 29 04:50:44 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c 1073741824" returned: 0 in 0.938s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Acquiring lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" acquired by "delete_volume" :: waited 0.042s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:44 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:50:44 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8df5d-a183-406d-bd44-6689ad8ce920]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:44 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24
Jun 29 04:50:44 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:45 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 0.804s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1105791307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b07c9-5d88-480d-aecb-37e1f990f820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3dae14f1ae490ca5e48219687b0a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:42Z,use_quota=True,user_id='f96128a90a5d49ab8e278e4194ab3c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Creating volume 5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:50:45 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:45 devstack sudo[102522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 1073741824
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b205075b-d957-4357-94e1-03c1eb83b233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343d845f-e32e-40b4-a4a9-ee486adc836c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:45 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139e9f54-8422-4ce9-99c1-a6247f4ae6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Volume volume-343d845f-e32e-40b4-a4a9-ee486adc836c (343d845f-e32e-40b4-a4a9-ee486adc836c): created successfully
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139e9f54-8422-4ce9-99c1-a6247f4ae6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (b2d9f604-795f-41a8-a2bf-099925b78eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ec1e8e52-2331-47d8-b1df-c9c243e67bad tempest-GroupSnapshotsTest-1977655564 None] Created volume successfully.
Jun 29 04:50:45 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24" returned: 0 in 0.993s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:45 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24
Jun 29 04:50:45 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:46 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-88ebb25f-9b72-4e50-a389-8d2f0e21db24" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:46 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 1073741824" returned: 0 in 1.037s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-88ebb25f-9b72-4e50-a389-8d2f0e21db24" released by "delete_volume" :: held 1.843s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:46 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820
Jun 29 04:50:46 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] GroupSnapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: creating.
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Created reservations ['8f24b9a7-38f4-47f3-a7b0-99603cd8880a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Group snapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: creating. {{(pid=93723) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 29 04:50:46 devstack cinder-volume[93723]: WARNING cinder.quota [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2082716732 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2082716732, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:46 devstack cinder-volume[93723]: WARNING cinder.quota [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2082716732 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2082716732, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Created reservations ['9b3a2fad-90f1-43aa-9497-e0379f62f9b0', 'a1c36958-4927-4c48-ab3b-ed8264d49e7a', '525ffb58-220e-42ad-915c-7ba494d5fecf', '71a68e7c-0d18-404f-a95e-c42be8e17efd'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:46 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:46 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:47 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.583s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc874f6-0481-44e4-b11e-c8db7810ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8b07c9-5d88-480d-aecb-37e1f990f820', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575087bf-b41f-4911-9a0e-3504bd26dbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Creating offline snapshot 7674be8f-419e-4b04-8304-14aee7abb5ac of volume 343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:50:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Volume volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 (5f8b07c9-5d88-480d-aecb-37e1f990f820): created successfully
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575087bf-b41f-4911-9a0e-3504bd26dbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Flow 'volume_create_manager' (b9862136-f3e3-44ff-b2d3-3442db78d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f9e389-1fd5-4d57-ae91-ccb8730402fe]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-e83ccc63-5afc-4642-853a-81248f4c2471 req-2c9b9608-34e9-4325-82ab-122ac078a12c tempest-VolumesSnapshotsTestJSON-1081543482 None] Created volume successfully.
Jun 29 04:50:47 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:50:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:47 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1bbba2d-99b9-444e-a71e-798ee5da4ee2 tempest-GroupsV314Test-1958600473 None] Delete group completed successfully.
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Acquiring lock "cinder-quobyte-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a475a0c1-c898-40fd-ae8b-c0add6df9ec3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:47 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:47 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:48 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 0.986s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:48 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac 1G
Jun 29 04:50:48 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:48 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 1.002s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:48 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8
Jun 29 04:50:48 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:49 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac 1G" returned: 0 in 0.928s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343d845f-e32e-40b4-a4a9-ee486adc836c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:49 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343d845f-e32e-40b4-a4a9-ee486adc836c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:50:49 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:49 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Lock "cinder-quobyte-30c8b073-4f9c-46a0-a3c9-0eebb7cec1f8" released by "delete_volume" :: held 1.816s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Created reservations ['9e129620-f30e-4b23-9114-e81d29e76e0a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Created reservations ['bad8e18e-374e-4809-ba5e-4bdf0bddfdd3', '2ee88c79-a80f-4c49-8323-f27e2f637bf5', '915cbc0c-5d50-4511-9c2e-1aaec5174414', 'ee91858d-c2e3-4b08-84c7-338723afc81f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:49 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:50:49 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:50 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343d845f-e32e-40b4-a4a9-ee486adc836c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 0.735s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:50 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:50 devstack sudo[102573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:50:50 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:50 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:50:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a1c91ece-c395-4104-a99c-a0ae39e29ae4 tempest-GroupsV314Test-1958600473 None] Delete group completed successfully.
Jun 29 04:50:50 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 0.794s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:50 devstack sudo[102577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info
Jun 29 04:50:50 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:51 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:51 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:50:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:51 devstack sudo[102582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info
Jun 29 04:50:51 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:52 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.info" returned: 0 in 0.777s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.097s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.121s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Creating offline snapshot f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 of volume 5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3b733b-123b-4dfb-8568-6052211c63d6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b0db51e1-d199-4b66-a47f-be9c0d82d372 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: created successfully
Jun 29 04:50:52 devstack sudo[102585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820
Jun 29 04:50:52 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:53 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820" returned: 0 in 0.908s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:53 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 1G
Jun 29 04:50:53 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:54 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 1G" returned: 0 in 0.921s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:54 devstack sudo[102597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6
Jun 29 04:50:54 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:55 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" returned: 0 in 0.858s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:55 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 is being set with open permissions: ugo+rw
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:55 devstack sudo[102603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6
Jun 29 04:50:55 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (e2f7b020-152c-48cb-a1aa-95414f42631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b41988d-0744-450a-a0dc-3ebfd00123bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b41988d-0744-450a-a0dc-3ebfd00123bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-310413443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a577ae3-990b-4ee6-9e06-5a51b47f9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:55Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7078e120-b0f1-48e2-82e4-7f5e25fab525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7078e120-b0f1-48e2-82e4-7f5e25fab525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4cd7b1-fca1-46af-b5c5-0566351c0fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4cd7b1-fca1-46af-b5c5-0566351c0fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a577ae3-990b-4ee6-9e06-5a51b47f9ccb', 'volume_name': 'volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a8c52c-eff1-4b90-b2c4-ca60dd67618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a8c52c-eff1-4b90-b2c4-ca60dd67618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04ecb9-993f-4678-b106-39d8c76bd9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:50:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Volume 0a577ae3-990b-4ee6-9e06-5a51b47f9ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb', 'volume_size': 1}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:55 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" returned: 0 in 0.707s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:56 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info
Jun 29 04:50:56 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:56 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info" returned: 0 in 0.684s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:56 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info is being set with open permissions: ugo+rw
Jun 29 04:50:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:56 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info
Jun 29 04:50:56 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:57 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.info" returned: 0 in 0.662s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.859s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.902s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac-731442e4-1825-4255-a47a-e605158bcdb2" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac-731442e4-1825-4255-a47a-e605158bcdb2" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Creating volume 731442e4-1825-4255-a47a-e605158bcdb2 from snapshot 7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-016a6b9c-3425-40a2-9f5a-64b5fc6469dd req-a22d93df-fd82-400b-ae26-6c00a6131bad tempest-VolumesSnapshotsTestJSON-1081543482 None] Create snapshot completed successfully
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] snapshot: 7674be8f-419e-4b04-8304-14aee7abb5ac, volume: 731442e4-1825-4255-a47a-e605158bcdb2,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6900b6-56d0-4aee-83b9-4c26f089d9b2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:57 devstack sudo[102612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:50:57 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:58 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 0.821s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343d845f-e32e-40b4-a4a9-ee486adc836c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17bcc7e-79f5-4fde-8d50-13e8d946ca1f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:58 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:50:58 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "cinder-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "cinder-quobyte-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Deleting offline snapshot f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 of volume 5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] snapshot_file for this snap is: volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a53ac86-974e-41b9-af87-fc90bf98b7b4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:58 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6
Jun 29 04:50:58 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:59 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 0.924s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:59 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2
Jun 29 04:50:59 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:50:59 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" returned: 0 in 0.936s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f8b07c9-5d88-480d-aecb-37e1f990f820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5f66e-2319-4820-9ae3-3e9a84580616]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:50:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:50:59 devstack sudo[102633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820
Jun 29 04:50:59 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:00 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820" returned: 0 in 1.390s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:01 devstack sudo[102648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6
Jun 29 04:51:01 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:02 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" returned: 0 in 1.720s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:02 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6
Jun 29 04:51:02 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:03 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:03 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:03 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820.f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" returned: 0 in 1.198s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6" released by "_delete_snapshot" :: held 5.460s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" released by "delete_snapshot" :: held 5.492s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.quota [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Created reservations ['eef8e99d-5112-4ad3-8d20-9927df9cafa0', 'df988682-bb75-458f-af01-b05d638939f7', '2e88dc5a-3b5c-4a93-bb47-22a8d5ab5bb5', '9a235859-23d9-410d-b48a-d8b0e93ebca5'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Delete snapshot completed successfully.
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-f65efb38-3cf4-484f-9112-b3bdbbcc65b7 req-4b39f5d9-f598-4266-bb85-02e88f69685a tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-f5ad5d33-b4be-4ed1-a19f-83b7b4429ae6-delete_snapshot" released by "delete_snapshot" :: held 5.796s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "cinder-5f8b07c9-5d88-480d-aecb-37e1f990f820-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-5f8b07c9-5d88-480d-aecb-37e1f990f820-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" acquired by "delete_volume" :: waited 0.057s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5763f67c-1721-4467-967b-55fc7f2cba39]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:05 devstack sudo[102695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820
Jun 29 04:51:05 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:05 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2" returned: 0 in 6.352s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:05 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 2.129s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c3f98-2415-493e-909e-391d08b5c2aa]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 8 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:51:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:51:05 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:51:05 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:06 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820" returned: 0 in 1.148s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:06 devstack sudo[102704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820
Jun 29 04:51:06 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:06 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:51:06 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Converted 1024.00 MB image at 161.15 MB/s
Jun 29 04:51:06 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:06 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2
Jun 29 04:51:06 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:06 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5f8b07c9-5d88-480d-aecb-37e1f990f820" returned: 0 in 0.654s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-quobyte-5f8b07c9-5d88-480d-aecb-37e1f990f820" released by "delete_volume" :: held 1.968s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG cinder.quota [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Created reservations ['2671eb0d-1638-4b5c-aeec-7820b03ba55e', 'a723e07c-65a3-46d5-a46e-ba578c4a64d0', 'b34b940d-49f6-4806-8273-f625743df487', 'ed70c8cd-e31f-4489-a350-73aed1cf3702'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:06 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:06 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:07 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2" returned: 0 in 0.755s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" released by "_copy_volume_from_snapshot" :: held 9.996s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac-731442e4-1825-4255-a47a-e605158bcdb2" released by "_create_volume_from_snapshot" :: held 10.035s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.066s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.046s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-310413443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a577ae3-990b-4ee6-9e06-5a51b47f9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:50:55Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Creating volume 0a577ae3-990b-4ee6-9e06-5a51b47f9ccb {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:07 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:07 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb 1073741824
Jun 29 04:51:07 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-76956b33-6a1f-44b6-bbdc-b160e40b1f8e tempest-GroupSnapshotsTest-1977655564 None] Create group from source-snapshot-82c33eb4-b412-42b4-a50a-ed937d90aa5d completed successfully.
Jun 29 04:51:07 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.942s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.manager [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Deleted volume successfully.
Jun 29 04:51:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-06bf8a9b-061f-4352-b2aa-3104491e8937 req-d0b5503d-e96d-48b7-a069-e00b913872f6 tempest-VolumesSnapshotsTestJSON-1081543482 None] Lock "cinder-5f8b07c9-5d88-480d-aecb-37e1f990f820-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa9f5d-aa87-444c-9b66-4b9f47cfc2e3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:08 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb 1073741824" returned: 0 in 1.194s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:08 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2
Jun 29 04:51:08 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:08 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb
Jun 29 04:51:08 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:09 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2" returned: 0 in 0.988s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:09 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2
Jun 29 04:51:09 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:09 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" returned: 0 in 0.880s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04ecb9-993f-4678-b106-39d8c76bd9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fefea51-3cad-43a7-9569-d47d3856d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:09 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Volume volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb (0a577ae3-990b-4ee6-9e06-5a51b47f9ccb): created successfully
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fefea51-3cad-43a7-9569-d47d3856d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (e2f7b020-152c-48cb-a1aa-95414f42631a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ffccb31b-a007-4fe1-88e8-f929e8df935e tempest-VolumesListAdminTestJSON-458884130 None] Created volume successfully.
Jun 29 04:51:10 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-731442e4-1825-4255-a47a-e605158bcdb2" returned: 0 in 0.816s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-731442e4-1825-4255-a47a-e605158bcdb2" released by "delete_volume" :: held 1.865s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['9c0ecfaf-6e3a-4041-8967-fddf775e9f20'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:10 devstack cinder-volume[93723]: WARNING cinder.quota [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-246585201 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-246585201, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:10 devstack cinder-volume[93723]: WARNING cinder.quota [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-246585201 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-246585201, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['2bcb90c2-4646-4856-8717-4a96d0b81090', '5274c40e-2c03-4d0c-9af4-4556b1348aa0', 'a64a46a3-fb92-4cca-a0bd-12ab5b3f5f90', '4aeb8edb-bea0-472e-83d4-5f9f1608e92a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:10 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:10 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: deleting
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: deleting {{(pid=93723) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Deleting offline snapshot 7674be8f-419e-4b04-8304-14aee7abb5ac of volume 343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] snapshot_file for this snap is: volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225cc80-631a-42a7-be4c-bc60d765dce6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:11 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.836s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4817b307-b7de-43a6-ae16-8398a889a0e5 tempest-GroupSnapshotsTest-1977655564 None] Delete group completed successfully.
Jun 29 04:51:11 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:51:11 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (70d9289c-e8f9-4a02-8ef5-ff13d20edf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8ada80-0069-4992-af7e-db99582c4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8ada80-0069-4992-af7e-db99582c4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434593624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87b0ad6-671a-40b5-a994-5bf386dee151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:12Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f155e4de-9dc4-427b-92a1-e7f9c029c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f155e4de-9dc4-427b-92a1-e7f9c029c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080b1cd-9553-4a8f-ac0e-eaa5c3dfd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f080b1cd-9553-4a8f-ac0e-eaa5c3dfd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87b0ad6-671a-40b5-a994-5bf386dee151', 'volume_name': 'volume-d87b0ad6-671a-40b5-a994-5bf386dee151', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df34590d-f6ff-420b-ac85-b3407c9fa18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df34590d-f6ff-420b-ac85-b3407c9fa18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebeb898d-faa6-482b-90f3-932898cba181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:11 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Volume d87b0ad6-671a-40b5-a994-5bf386dee151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87b0ad6-671a-40b5-a994-5bf386dee151', 'volume_size': 1}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434593624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87b0ad6-671a-40b5-a994-5bf386dee151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:12Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Creating volume d87b0ad6-671a-40b5-a994-5bf386dee151 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:11 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:11 devstack sudo[102738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 1073741824
Jun 29 04:51:11 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:12 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 1.016s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343d845f-e32e-40b4-a4a9-ee486adc836c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff48b6-0001-4973-b6d2-692a76a48988]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:12 devstack sudo[102743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:51:12 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:12 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 1073741824" returned: 0 in 1.035s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:12 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151
Jun 29 04:51:12 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:13 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 0.846s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:13 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:51:13 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-da9b6706-7123-43c9-bff6-381a47898762 tempest-BackendsCapabilitiesAdminTestsJSON-1288770467 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93723) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 29 04:51:13 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151" returned: 0 in 0.700s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebeb898d-faa6-482b-90f3-932898cba181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87b0ad6-671a-40b5-a994-5bf386dee151', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acc21ec-027c-45b8-bed8-e6bbcf194d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:13 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Volume volume-d87b0ad6-671a-40b5-a994-5bf386dee151 (d87b0ad6-671a-40b5-a994-5bf386dee151): created successfully
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acc21ec-027c-45b8-bed8-e6bbcf194d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (70d9289c-e8f9-4a02-8ef5-ff13d20edf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dedf45c4-3dbc-460b-9bd8-ae29612ceb88 tempest-VolumesListAdminTestJSON-458884130 None] Created volume successfully.
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Flow 'volume_create_manager' (86c2f5da-9fa6-44ea-9d91-7af9a3bcb90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e24d576-8d61-4672-86e7-2682f96e5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-54850203-b672-4b83-85d4-f91d9abd610b tempest-BackendsCapabilitiesAdminTestsJSON-1288770467 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93723) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e24d576-8d61-4672-86e7-2682f96e5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1355042951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d11cee-e08c-4646-8aa2-1bb3081dd6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af731eaff57d48ff8373246329dded09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:14Z,use_quota=True,user_id='baea5e674b344f36836fe914488def17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec4460d-267d-4841-8806-7a8630105f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec4460d-267d-4841-8806-7a8630105f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a524ee-8c53-4d53-816f-4215e7009d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a524ee-8c53-4d53-816f-4215e7009d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d11cee-e08c-4646-8aa2-1bb3081dd6a6', 'volume_name': 'volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f50450-aaa7-4c0c-9622-50ef62747622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f50450-aaa7-4c0c-9622-50ef62747622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d748daad-7579-4653-bae0-d0eebf02662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Volume 43d11cee-e08c-4646-8aa2-1bb3081dd6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6', 'volume_size': 1}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1355042951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d11cee-e08c-4646-8aa2-1bb3081dd6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af731eaff57d48ff8373246329dded09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:14Z,use_quota=True,user_id='baea5e674b344f36836fe914488def17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Creating volume 43d11cee-e08c-4646-8aa2-1bb3081dd6a6 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:14 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:14 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 0.819s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:14 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 1073741824
Jun 29 04:51:14 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:14 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac
Jun 29 04:51:14 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (6891a720-a7fe-4273-804c-50131f2038bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcffd23-1807-4f04-b7ec-8bef16e12e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcffd23-1807-4f04-b7ec-8bef16e12e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187174310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4819dcc-5966-482a-b406-0c3c23357666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:14Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f425a73-3310-48ac-9366-e386d1a380ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f425a73-3310-48ac-9366-e386d1a380ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adcae8d-cae6-4fa1-8e24-f92a76f8f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adcae8d-cae6-4fa1-8e24-f92a76f8f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4819dcc-5966-482a-b406-0c3c23357666', 'volume_name': 'volume-c4819dcc-5966-482a-b406-0c3c23357666', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acd7c87-9037-41dc-bf39-cf38960c08bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acd7c87-9037-41dc-bf39-cf38960c08bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff67c82-5d6d-4fc0-99dd-954e01643007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Volume c4819dcc-5966-482a-b406-0c3c23357666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4819dcc-5966-482a-b406-0c3c23357666', 'volume_size': 1}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:14 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c.7674be8f-419e-4b04-8304-14aee7abb5ac" returned: 0 in 0.728s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-7674be8f-419e-4b04-8304-14aee7abb5ac" released by "_delete_snapshot" :: held 3.569s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" released by "delete_snapshot" :: held 3.602s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:14 devstack cinder-volume[93723]: WARNING cinder.quota [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-246585201 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-246585201, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['d569777e-b7f8-42da-b8ca-d562f6bf50d2', '46aa5d78-78eb-4212-8a47-d4491419eeb2', 'eaf222f4-5121-4562-902e-e7ff4337f17b', '4baf228e-3189-49fe-ad1e-4e5978784ba1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:14 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 1073741824" returned: 0 in 0.936s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fb5be301-fe94-40d8-acda-4aa29bb67b78 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 82c33eb4-b412-42b4-a50a-ed937d90aa5d: deleted successfully
Jun 29 04:51:15 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6
Jun 29 04:51:15 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:15 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" returned: 0 in 0.668s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187174310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4819dcc-5966-482a-b406-0c3c23357666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a899d66fd147e4869d0c38d19b59b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:14Z,use_quota=True,user_id='6e4a9d33c2534c0e809483d75c84b62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Creating volume c4819dcc-5966-482a-b406-0c3c23357666 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:15 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:15 devstack sudo[102774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 1073741824
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d748daad-7579-4653-bae0-d0eebf02662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:15 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c35588-1c98-45c9-a7a9-29fc06e556ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:15 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Volume volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 (43d11cee-e08c-4646-8aa2-1bb3081dd6a6): created successfully
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c35588-1c98-45c9-a7a9-29fc06e556ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Flow 'volume_create_manager' (86c2f5da-9fa6-44ea-9d91-7af9a3bcb90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-51461741-fb48-440e-9519-603cdc2818a0 tempest-VolumesTransfersV357Test-250543050 None] Created volume successfully.
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8da408-aa2a-4cdd-b218-cc34a38218c8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:16 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:51:16 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:16 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 1073741824" returned: 0 in 1.190s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:16 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666
Jun 29 04:51:16 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f1b3d16d-2120-46ad-b1e4-5e9198638c34 tempest-VolumesTransfersV357Test-199935435 None] Transfer volume completed successfully.
Jun 29 04:51:17 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 1.003s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:17 devstack sudo[102788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c
Jun 29 04:51:17 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:17 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff67c82-5d6d-4fc0-99dd-954e01643007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4819dcc-5966-482a-b406-0c3c23357666', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ae252-63f1-4f38-836b-5c894c0adf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:17 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Volume volume-c4819dcc-5966-482a-b406-0c3c23357666 (c4819dcc-5966-482a-b406-0c3c23357666): created successfully
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ae252-63f1-4f38-836b-5c894c0adf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Flow 'volume_create_manager' (6891a720-a7fe-4273-804c-50131f2038bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-37510034-003f-45ab-a221-aacf1ed78742 tempest-VolumesListAdminTestJSON-458884130 None] Created volume successfully.
Jun 29 04:51:18 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-343d845f-e32e-40b4-a4a9-ee486adc836c" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-343d845f-e32e-40b4-a4a9-ee486adc836c" released by "delete_volume" :: held 1.815s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['e3c69aba-506a-44e6-8ba1-9fb632f2e0fc'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:18 devstack cinder-volume[93723]: WARNING cinder.db.api [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-246585201']
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['60b40f8a-c3bc-4c96-8eaf-5c4d655f9fa7', 'ce7fcf53-a59e-46fc-96c7-ceb713dc102b', '03d302f2-b1cf-4938-9a6a-2a533fc88a3f', 'd205facd-7254-4a00-ac5a-6e5d22e24318'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:18 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:18 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "cinder-43d11cee-e08c-4646-8aa2-1bb3081dd6a6-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-43d11cee-e08c-4646-8aa2-1bb3081dd6a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "cinder-quobyte-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-quobyte-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe5e6a-7fc7-4a77-b318-58dad4c1f422]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:18 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6
Jun 29 04:51:18 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:19 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.967s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:19 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-20a8be80-79dd-41a3-ae57-d0927daf5560 tempest-GroupSnapshotsTest-1977655564 None] Delete group completed successfully.
Jun 29 04:51:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-051339e7-a976-469c-a13e-7570514bdb4e tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-1299919202: creating
Jun 29 04:51:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-051339e7-a976-469c-a13e-7570514bdb4e tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-1299919202: created successfully
Jun 29 04:51:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-051339e7-a976-469c-a13e-7570514bdb4e tempest-GroupSnapshotsTest-1977655564 None] Create group completed successfully.
Jun 29 04:51:19 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" returned: 0 in 1.175s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:19 devstack sudo[102801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6
Jun 29 04:51:19 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:19 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Flow 'volume_create_manager' (d8954df4-6f89-46a8-88da-fdd732fc8e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb098ce-b89a-4547-97a6-94e528e0cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb098ce-b89a-4547-97a6-94e528e0cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03ee40b-54a0-49b8-abeb-54423365db35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2732b6ca4b8e4649ae81e0354596fd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:20Z,use_quota=True,user_id='3e11a7df7ea3412b8780046fbaba92dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce6c851-050e-4479-9dc7-225f929c2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce6c851-050e-4479-9dc7-225f929c2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82af646-8d99-4f99-8d24-ea96f2ed0b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82af646-8d99-4f99-8d24-ea96f2ed0b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03ee40b-54a0-49b8-abeb-54423365db35', 'volume_name': 'volume-f03ee40b-54a0-49b8-abeb-54423365db35', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cf65d3-1b03-4907-856e-df22b32e1e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cf65d3-1b03-4907-856e-df22b32e1e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a608ed40-3897-4e93-98b2-3f81c048f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:20 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Volume f03ee40b-54a0-49b8-abeb-54423365db35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03ee40b-54a0-49b8-abeb-54423365db35', 'volume_size': 1}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03ee40b-54a0-49b8-abeb-54423365db35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2732b6ca4b8e4649ae81e0354596fd2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:20Z,use_quota=True,user_id='3e11a7df7ea3412b8780046fbaba92dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Creating volume f03ee40b-54a0-49b8-abeb-54423365db35 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:20 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:20 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 1073741824
Jun 29 04:51:20 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:20 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" returned: 0 in 0.689s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-quobyte-43d11cee-e08c-4646-8aa2-1bb3081dd6a6" released by "delete_volume" :: held 1.917s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Created reservations ['fc339a5d-881b-41c6-8f8d-4f15f0a749d4', 'f3992b96-4caf-43cc-b2ae-2f589223b151', '61d81896-40f8-4525-9302-6453fea35e3c', 'ce1be6b5-a671-4b65-8aee-fe27bd1b744b'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:20 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:20 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:21 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 1073741824" returned: 0 in 1.170s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:21 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35
Jun 29 04:51:21 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (77977843-369d-4b51-a6b5-cb33cad9f21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a35788-bb6f-409c-9ab5-6a002add14fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a35788-bb6f-409c-9ab5-6a002add14fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356485145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,host='devstack@QuobyteHD#QuobyteHD',id=23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:21Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6888e7a1-1bac-450f-ac63-defdee87fccd),volume_type_id=6888e7a1-1bac-450f-ac63-defdee87fccd)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6292144-d201-4817-a597-4b45a99498ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6292144-d201-4817-a597-4b45a99498ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e209dba1-74ad-41cc-a12c-22e2a4faaf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e209dba1-74ad-41cc-a12c-22e2a4faaf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7', 'volume_name': 'volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cce84f-0fd4-4bdd-a4b9-207184a279b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cce84f-0fd4-4bdd-a4b9-207184a279b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59c54f-d62c-452e-8a2d-9a9a6bad3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Volume 23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7', 'volume_size': 1}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:21 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.118s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Deleted volume successfully.
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Flow 'volume_create_manager' (0032c221-8667-4070-88b7-c6e528df8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e083a919-3350-4bfa-af8d-7b268898d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a89d6641-2b65-478b-997b-8ffe269dd503 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-43d11cee-e08c-4646-8aa2-1bb3081dd6a6-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e083a919-3350-4bfa-af8d-7b268898d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1721080549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956bb935-e225-4be2-9cde-38b1e4918a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af731eaff57d48ff8373246329dded09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:22Z,use_quota=True,user_id='baea5e674b344f36836fe914488def17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e159f692-06bc-4a3b-a398-1ea0e668736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e159f692-06bc-4a3b-a398-1ea0e668736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1c8230-4346-4190-a6d5-cd722376c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1c8230-4346-4190-a6d5-cd722376c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956bb935-e225-4be2-9cde-38b1e4918a5c', 'volume_name': 'volume-956bb935-e225-4be2-9cde-38b1e4918a5c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2a74ac-e0a1-415c-aaa6-1de741e5efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2a74ac-e0a1-415c-aaa6-1de741e5efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b9c758-54b7-4aec-a6c1-81b64d4ef5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:21 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Volume 956bb935-e225-4be2-9cde-38b1e4918a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956bb935-e225-4be2-9cde-38b1e4918a5c', 'volume_size': 1}
Jun 29 04:51:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:22 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,created_at=2026-06-29T02:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-356485145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,host='devstack@QuobyteHD#QuobyteHD',id=23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:21Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6888e7a1-1bac-450f-ac63-defdee87fccd),volume_type_id=6888e7a1-1bac-450f-ac63-defdee87fccd)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Creating volume 23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:22 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a608ed40-3897-4e93-98b2-3f81c048f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03ee40b-54a0-49b8-abeb-54423365db35', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0a2f13-c3d6-48f2-9b7a-3445accc8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:22 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 1073741824
Jun 29 04:51:22 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:22 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Volume volume-f03ee40b-54a0-49b8-abeb-54423365db35 (f03ee40b-54a0-49b8-abeb-54423365db35): created successfully
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0a2f13-c3d6-48f2-9b7a-3445accc8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Flow 'volume_create_manager' (d8954df4-6f89-46a8-88da-fdd732fc8e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:22 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0ebd0a28-a011-40a8-ae1e-dc45f8c6ebb2 tempest-VolumesListAdminTestJSON-844877529 None] Created volume successfully.
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Acquiring lock "cinder-f03ee40b-54a0-49b8-abeb-54423365db35-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "cinder-f03ee40b-54a0-49b8-abeb-54423365db35-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Acquiring lock "cinder-quobyte-f03ee40b-54a0-49b8-abeb-54423365db35" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "cinder-quobyte-f03ee40b-54a0-49b8-abeb-54423365db35" acquired by "delete_volume" :: waited 0.042s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ead501-7e01-428b-b268-d8d8e8025511]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-c4819dcc-5966-482a-b406-0c3c23357666-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-c4819dcc-5966-482a-b406-0c3c23357666-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-quobyte-c4819dcc-5966-482a-b406-0c3c23357666" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-c4819dcc-5966-482a-b406-0c3c23357666" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:23 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35
Jun 29 04:51:23 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603a8f3-9470-4792-a92c-a24c93b5a052]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:23 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666
Jun 29 04:51:23 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:23 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 1073741824" returned: 0 in 1.207s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:23 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7
Jun 29 04:51:23 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:23 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35" returned: 0 in 0.968s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:23 devstack sudo[102831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35
Jun 29 04:51:23 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:24 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666" returned: 0 in 1.064s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:24 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666
Jun 29 04:51:24 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:24 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" returned: 0 in 0.854s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.476s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1721080549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956bb935-e225-4be2-9cde-38b1e4918a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af731eaff57d48ff8373246329dded09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:22Z,use_quota=True,user_id='baea5e674b344f36836fe914488def17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Creating volume 956bb935-e225-4be2-9cde-38b1e4918a5c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:24 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59c54f-d62c-452e-8a2d-9a9a6bad3cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b690c537-9dcc-4cdf-9c92-63321df9fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:24 devstack sudo[102839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c 1073741824
Jun 29 04:51:24 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Volume volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 (23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7): created successfully
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b690c537-9dcc-4cdf-9c92-63321df9fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (77977843-369d-4b51-a6b5-cb33cad9f21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-16893f81-9303-4742-9bcf-d128a47f460a tempest-GroupSnapshotsTest-1977655564 None] Created volume successfully.
Jun 29 04:51:24 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f03ee40b-54a0-49b8-abeb-54423365db35" returned: 0 in 0.886s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "cinder-quobyte-f03ee40b-54a0-49b8-abeb-54423365db35" released by "delete_volume" :: held 1.920s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Created reservations ['29e9d538-4672-45be-90d5-9f871530dc7f', '28abeecd-6461-4961-b35b-ba0fc3ed74d4', '3119f3c9-0386-46cf-a375-eda9f6fb0eeb', '3f1a3122-fff6-4175-ae34-cbbdf40ec3b1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:25 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:25 devstack sudo[102844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c4819dcc-5966-482a-b406-0c3c23357666" returned: 0 in 0.773s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:25 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-c4819dcc-5966-482a-b406-0c3c23357666" released by "delete_volume" :: held 1.889s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Created reservations ['3958ae4a-b585-4f70-95dd-0fd93ed73488', 'bd91aaef-796d-4a25-a25e-9279e86067ca', '95312140-0490-4d5c-ac3a-4cb0c5c6b853', 'e5217579-49ef-420e-93f1-436a0c4eff11'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:25 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:25 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-d87b0ad6-671a-40b5-a994-5bf386dee151-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-d87b0ad6-671a-40b5-a994-5bf386dee151-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-quobyte-d87b0ad6-671a-40b5-a994-5bf386dee151" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-d87b0ad6-671a-40b5-a994-5bf386dee151" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:25 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c 1073741824" returned: 0 in 1.226s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740bec8-727a-4d54-a2c5-a77a1418b84f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:25 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c
Jun 29 04:51:25 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:25 devstack sudo[102852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151
Jun 29 04:51:25 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:26 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.926s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Deleted volume successfully.
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64243314-4904-4371-8c3c-ae07e1a45493 tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-c4819dcc-5966-482a-b406-0c3c23357666-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:26 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.475s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Deleted volume successfully.
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-260eadf2-7f22-458a-bf0d-6e81b2044431 tempest-VolumesListAdminTestJSON-844877529 None] Lock "cinder-f03ee40b-54a0-49b8-abeb-54423365db35-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (de20a89b-4bf8-42b9-881c-8cee76da35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7597baab-fc44-4e56-9fe4-5769e248b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7597baab-fc44-4e56-9fe4-5769e248b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536405144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,host='devstack@QuobyteHD#QuobyteHD',id=d4f805f5-63ee-4952-bd38-0a9b7f2a866b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:27Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6888e7a1-1bac-450f-ac63-defdee87fccd),volume_type_id=6888e7a1-1bac-450f-ac63-defdee87fccd)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966d0205-f647-4529-a234-1739fc39eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966d0205-f647-4529-a234-1739fc39eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ba753f-f611-45fc-a117-f04b1ee6c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ba753f-f611-45fc-a117-f04b1ee6c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f805f5-63ee-4952-bd38-0a9b7f2a866b', 'volume_name': 'volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f80ef4c-f577-460c-9952-51e7d61992dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f80ef4c-f577-460c-9952-51e7d61992dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69559caf-4c4e-4904-9ea0-52fda4ce3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Volume d4f805f5-63ee-4952-bd38-0a9b7f2a866b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b', 'volume_size': 1}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:26 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c" returned: 0 in 1.027s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.066s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,created_at=2026-06-29T02:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536405144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1dcf6cf7-81ff-4df4-841a-008e0ed3b7f3,host='devstack@QuobyteHD#QuobyteHD',id=d4f805f5-63ee-4952-bd38-0a9b7f2a866b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:27Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6888e7a1-1bac-450f-ac63-defdee87fccd),volume_type_id=6888e7a1-1bac-450f-ac63-defdee87fccd)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Creating volume d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:26 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151" returned: 0 in 1.152s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:26 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b 1073741824
Jun 29 04:51:26 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b9c758-54b7-4aec-a6c1-81b64d4ef5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956bb935-e225-4be2-9cde-38b1e4918a5c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856c2682-8d17-4235-95c6-29dfdb83dfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:26 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151
Jun 29 04:51:26 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1c6d705-5624-459b-a17c-d712b45e0729 tempest-GroupsTest-496889888 None] Group tempest-Group1-1731992873: creating
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Volume volume-956bb935-e225-4be2-9cde-38b1e4918a5c (956bb935-e225-4be2-9cde-38b1e4918a5c): created successfully
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856c2682-8d17-4235-95c6-29dfdb83dfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Flow 'volume_create_manager' (0032c221-8667-4070-88b7-c6e528df8a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-daa10b99-4da6-4b55-b1bf-dea5888e7eac tempest-VolumesTransfersV357Test-250543050 None] Created volume successfully.
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1c6d705-5624-459b-a17c-d712b45e0729 tempest-GroupsTest-496889888 None] Group tempest-Group1-1731992873: created successfully
Jun 29 04:51:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1c6d705-5624-459b-a17c-d712b45e0729 tempest-GroupsTest-496889888 None] Create group completed successfully.
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "cinder-956bb935-e225-4be2-9cde-38b1e4918a5c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-956bb935-e225-4be2-9cde-38b1e4918a5c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:27 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d87b0ad6-671a-40b5-a994-5bf386dee151" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "cinder-quobyte-956bb935-e225-4be2-9cde-38b1e4918a5c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-d87b0ad6-671a-40b5-a994-5bf386dee151" released by "delete_volume" :: held 1.905s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-quobyte-956bb935-e225-4be2-9cde-38b1e4918a5c" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0045fe-10e2-4a7c-abf2-37314817a024]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Created reservations ['75f54abf-0332-457c-ad60-8a9e0feca608', 'd84722e3-ecc4-4246-b3b5-9e17fa28656c', '961118ce-abdb-4e83-8fa5-85cb2dc1d4b4', '26998be1-0938-4371-82be-58c681279781'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:27 devstack sudo[102873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c
Jun 29 04:51:27 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:27 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b 1073741824" returned: 0 in 0.923s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:27 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:27 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:27 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b
Jun 29 04:51:27 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "cinder-quobyte-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fbf624-0760-4950-905d-1d4f7da70c1c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:28 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb
Jun 29 04:51:28 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-23bf75b2-cf14-4acb-8df9-252a11ee3dab tempest-GroupsTest-496889888 None] Group tempest-Group2-1275158756: creating
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-23bf75b2-cf14-4acb-8df9-252a11ee3dab tempest-GroupsTest-496889888 None] Group tempest-Group2-1275158756: created successfully
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-23bf75b2-cf14-4acb-8df9-252a11ee3dab tempest-GroupsTest-496889888 None] Create group completed successfully.
Jun 29 04:51:28 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c" returned: 0 in 0.994s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:28 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.848s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:28 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c
Jun 29 04:51:28 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Deleted volume successfully.
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18e9ecb1-b1db-43a6-b906-5fbf25d3118e tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-d87b0ad6-671a-40b5-a994-5bf386dee151-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:28 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" returned: 0 in 0.888s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69559caf-4c4e-4904-9ea0-52fda4ce3647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf44851b-2f48-45af-a4cd-867d9f6ba32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Volume volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b (d4f805f5-63ee-4952-bd38-0a9b7f2a866b): created successfully
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf44851b-2f48-45af-a4cd-867d9f6ba32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (de20a89b-4bf8-42b9-881c-8cee76da35d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6cfd4def-3e98-4099-b590-3a0d42e43110 tempest-GroupSnapshotsTest-1977655564 None] Created volume successfully.
Jun 29 04:51:29 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" returned: 0 in 0.942s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:29 devstack sudo[102892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb
Jun 29 04:51:29 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:29 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a7d76023-0578-4a60-917d-d1219b638e30 tempest-GroupSnapshotsTest-1977655564 None] Update group completed successfully.
Jun 29 04:51:29 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-956bb935-e225-4be2-9cde-38b1e4918a5c" returned: 0 in 0.797s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-quobyte-956bb935-e225-4be2-9cde-38b1e4918a5c" released by "delete_volume" :: held 1.851s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Created reservations ['8105923d-da05-43a8-bf40-949af3265353', '2d42c63a-d83e-4e3a-a14e-85d278324383', '7c19e75b-27b2-46e8-aa65-2447c2523105', 'ce8c41d4-fe63-4a03-996c-c0ac93bce5d1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:29 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:29 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:29 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" returned: 0 in 0.682s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-quobyte-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb" released by "delete_volume" :: held 1.695s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Created reservations ['2e0c30a0-02fa-44c1-9389-9089830e3169', '0536d1c6-3f50-4efa-a732-e84e470cfbf4', '55bafc2a-056c-4a4a-ad08-808e876fac7a', 'baa59ab1-d6f9-4454-b1bf-cfff924a8404'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:29 devstack sudo[102898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:29 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (ce55832d-7508-464c-9d84-49284cb2b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae213bd9-ca32-412a-9b80-90d9dd03e71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae213bd9-ca32-412a-9b80-90d9dd03e71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507399210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e09ff7f-7265-44d2-b1db-3b11ae4b2eed,host='devstack@QuobyteHD#QuobyteHD',id=b8a32f40-d77e-4c8b-977b-98efdf54dae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:30Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab6690a-d40d-4f3f-bbb8-58dfbad3f7a7),volume_type_id=4ab6690a-d40d-4f3f-bbb8-58dfbad3f7a7)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766888d9-f5cb-454b-9545-2823d55948f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766888d9-f5cb-454b-9545-2823d55948f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d881938-1f99-400c-a831-919b8690d6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d881938-1f99-400c-a831-919b8690d6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a32f40-d77e-4c8b-977b-98efdf54dae8', 'volume_name': 'volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de61ce35-5f04-4925-953b-2901b24ba164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de61ce35-5f04-4925-953b-2901b24ba164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7a76e8-4df5-499e-a5b8-788225b8fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:30 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Volume b8a32f40-d77e-4c8b-977b-98efdf54dae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8', 'volume_size': 1}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e09ff7f-7265-44d2-b1db-3b11ae4b2eed,created_at=2026-06-29T02:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507399210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e09ff7f-7265-44d2-b1db-3b11ae4b2eed,host='devstack@QuobyteHD#QuobyteHD',id=b8a32f40-d77e-4c8b-977b-98efdf54dae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:30Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab6690a-d40d-4f3f-bbb8-58dfbad3f7a7),volume_type_id=4ab6690a-d40d-4f3f-bbb8-58dfbad3f7a7)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Creating volume b8a32f40-d77e-4c8b-977b-98efdf54dae8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:30 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:30 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 1073741824
Jun 29 04:51:30 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b43c5a1c-4447-4a05-a03f-8672388b2dab tempest-GroupSnapshotsTest-1977655564 None] Update group completed successfully.
Jun 29 04:51:30 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.126s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Deleted volume successfully.
Jun 29 04:51:30 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.830s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Deleted volume successfully.
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-07ca59b7-3dd7-4e00-a8c6-beaa156b5433 tempest-VolumesTransfersV357Test-1027482125 None] Lock "cinder-956bb935-e225-4be2-9cde-38b1e4918a5c-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0a5e9f8e-1f8e-4455-98df-0f819b19e40c tempest-VolumesListAdminTestJSON-458884130 None] Lock "cinder-0a577ae3-990b-4ee6-9e06-5a51b47f9ccb-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:31 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 1073741824" returned: 0 in 1.265s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:31 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8
Jun 29 04:51:31 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7148fa36-1152-4ccf-a97c-9edf36610efa tempest-GroupSnapshotsTest-1977655564 None] Update group completed successfully.
Jun 29 04:51:32 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8" returned: 0 in 0.827s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7a76e8-4df5-499e-a5b8-788225b8fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fe33f3-1637-4a20-8c57-6a36be8a8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:32 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Volume volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 (b8a32f40-d77e-4c8b-977b-98efdf54dae8): created successfully
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fe33f3-1637-4a20-8c57-6a36be8a8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (ce55832d-7508-464c-9d84-49284cb2b662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:32 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8509b966-d22c-4ebb-a08d-e23d8c222b5a tempest-GroupsTest-496889888 None] Created volume successfully.
Jun 29 04:51:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-108cf45f-d6bf-42c2-a358-a09920eae4b5 tempest-GroupSnapshotsTest-1977655564 None] Update group completed successfully.
Jun 29 04:51:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Acquiring lock "cinder-quobyte-b8a32f40-d77e-4c8b-977b-98efdf54dae8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-b8a32f40-d77e-4c8b-977b-98efdf54dae8" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:33 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d23c81-77b9-41e7-a2a6-fa336221d6f0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:33 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8
Jun 29 04:51:33 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:34 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8" returned: 0 in 0.982s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:34 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8
Jun 29 04:51:34 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] GroupSnapshot c0a50808-626b-4dc4-91ae-31478494b73c: creating.
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Group snapshot c0a50808-626b-4dc4-91ae-31478494b73c: creating. {{(pid=93723) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Creating offline snapshot 38eb20b9-8ab2-4b36-8916-610e50caa56e of volume 23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f825a-20f1-4b82-b9e4-d4d7860dc77d]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:35 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7
Jun 29 04:51:35 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:35 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b8a32f40-d77e-4c8b-977b-98efdf54dae8" returned: 0 in 0.963s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-b8a32f40-d77e-4c8b-977b-98efdf54dae8" released by "delete_volume" :: held 2.014s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Created reservations ['07d83fc3-9471-47da-a09c-cd20dd65181c'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:35 devstack cinder-volume[93723]: WARNING cinder.quota [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1570535826 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1570535826, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:35 devstack cinder-volume[93723]: WARNING cinder.quota [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1570535826 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1570535826, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Created reservations ['a62d43f2-068d-4fea-950b-1b6e22a3c5a8', 'c00e90fd-58f5-4c6a-837e-e8d5ab2a709c', '1f79bf82-d4b1-46e5-ab8d-0139fc32b2f2', '1e1b25ab-a1a1-4b28-bb96-ecec9822c10f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:35 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:35 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:35 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" returned: 0 in 0.934s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:35 devstack sudo[102927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e 1G
Jun 29 04:51:35 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (210a1204-40fb-4c0a-b8bc-fb6379fa190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de5c5eb-5259-4637-9d24-8dc8dac286c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de5c5eb-5259-4637-9d24-8dc8dac286c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2026136942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f307632-74de-4446-88aa-27c46ce9aaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57675bd5c0e944acbbdbd156acb58e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:36Z,use_quota=True,user_id='5d676a64302144f69d1b2e6b82b09ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ef383-a8da-476e-9e45-6416f31f0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ef383-a8da-476e-9e45-6416f31f0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba272e1-6db0-4830-925e-62d5ffb680b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba272e1-6db0-4830-925e-62d5ffb680b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f307632-74de-4446-88aa-27c46ce9aaf6', 'volume_name': 'volume-6f307632-74de-4446-88aa-27c46ce9aaf6', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de824a03-ce43-4901-9e15-d271f7ea1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de824a03-ce43-4901-9e15-d271f7ea1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc418fc-f9a7-4741-99f0-764f05bc0283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:35 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Volume 6f307632-74de-4446-88aa-27c46ce9aaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f307632-74de-4446-88aa-27c46ce9aaf6', 'volume_size': 1}
Jun 29 04:51:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Created reservations ['cf86b610-6685-4474-81f2-090d9f661a06'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:36 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:36 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:36 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.707s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bef3b2bc-c5bd-415a-b77c-ceb6a37ad5a1 tempest-GroupsTest-496889888 None] Delete group completed successfully.
Jun 29 04:51:36 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e 1G" returned: 0 in 1.011s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:36 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e
Jun 29 04:51:36 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:36 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.702s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:36 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7629cbdd-85dd-4533-b96e-5a0700aa0906 tempest-GroupsTest-496889888 None] Delete group completed successfully.
Jun 29 04:51:37 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e" returned: 0 in 0.743s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:37 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:37 devstack sudo[102943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e
Jun 29 04:51:37 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Flow 'volume_create_manager' (5a0933e2-968a-45f2-b544-f3b275c8ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b146b11d-cdf6-40b2-8204-671d2a083a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b146b11d-cdf6-40b2-8204-671d2a083a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-993055647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5d753b-41ae-4156-b99a-826d8d94ef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1145df72fe1b4bb7850e597fbb3d7e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:38Z,use_quota=True,user_id='b9e947df1864486785a29ab0ec953c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d4da55-02f2-4b24-84ac-c01bf12f5deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d4da55-02f2-4b24-84ac-c01bf12f5deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a43fe1-ac1d-497b-966a-256383606f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:37 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 04:51:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0f7b375b-d05c-4be9-ab18-e0ec6cfb7e1d tempest-GroupsTest-496889888 None] Group tempest-GroupsTest-Group-369292795: creating
Jun 29 04:51:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0f7b375b-d05c-4be9-ab18-e0ec6cfb7e1d tempest-GroupsTest-496889888 None] Group tempest-GroupsTest-Group-369292795: created successfully
Jun 29 04:51:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0f7b375b-d05c-4be9-ab18-e0ec6cfb7e1d tempest-GroupsTest-496889888 None] Create group completed successfully.
Jun 29 04:51:38 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e" returned: 0 in 0.710s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a43fe1-ac1d-497b-966a-256383606f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee5d753b-41ae-4156-b99a-826d8d94ef2c', 'volume_name': 'volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872e694f0>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d510a-8aa4-45ba-91a4-a137e3089b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:38 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info
Jun 29 04:51:38 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2d510a-8aa4-45ba-91a4-a137e3089b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d7e772-1942-4068-a18d-36bc258120c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Volume ee5d753b-41ae-4156-b99a-826d8d94ef2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872e694f0>}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Trying to clone ee5d753b-41ae-4156-b99a-826d8d94ef2c from image 715ee343-4947-44c8-82ac-b52ccc04493d at location (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 04:51:38 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Image download 20.69 MB at 20.69 MB/s
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[772736af-75e5-4693-a67c-e5cbf0773bf6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:38 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD
Jun 29 04:51:38 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:39 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info" returned: 0 in 0.717s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:39 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:39 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info
Jun 29 04:51:39 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (7002b0ba-9af4-4d69-99c5-f47d52fafc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efda980-5c5f-469f-886b-228c48f7a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efda980-5c5f-469f-886b-228c48f7a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1007561346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,host='devstack@QuobyteHD#QuobyteHD',id=ed841e71-c015-4f27-adc7-0184d8aa3429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:39Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1197c70-9bb0-48b8-b1c9-241b518b7c1e),volume_type_id=f1197c70-9bb0-48b8-b1c9-241b518b7c1e)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b5e197-5c8d-4396-b0bd-856168dfe265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b5e197-5c8d-4396-b0bd-856168dfe265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809d7569-2a93-46d9-9abc-e172cc63a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809d7569-2a93-46d9-9abc-e172cc63a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed841e71-c015-4f27-adc7-0184d8aa3429', 'volume_name': 'volume-ed841e71-c015-4f27-adc7-0184d8aa3429', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701df804-d939-4e74-bff2-2507774eaf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:39 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701df804-d939-4e74-bff2-2507774eaf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da008fae-0671-455c-93d6-c3ac49b482e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Volume ed841e71-c015-4f27-adc7-0184d8aa3429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed841e71-c015-4f27-adc7-0184d8aa3429', 'volume_size': 1}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d is fetched for user b9e947df1864486785a29ab0ec953c0a. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a819daa0-6df5-4e4b-8ad2-35fe13369535]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:39 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.info" returned: 0 in 0.747s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:39 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD
Jun 29 04:51:39 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Creating offline snapshot 87b58dee-8a77-4ccf-8d0c-41985f6b9f47 of volume d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feec13b-1ec3-405c-b95e-9d24e255270e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:39 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b
Jun 29 04:51:39 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:40 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:40 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" returned: 0 in 0.739s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:40 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 1G
Jun 29 04:51:40 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:41 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 1G" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:41 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47
Jun 29 04:51:41 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:42 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:42 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:42 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47
Jun 29 04:51:42 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:42 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47" returned: 0 in 0.626s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=167,cinder:SELECT=157,cinder:DELETE=9,cinder:INSERT=33 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=181,cinder:SELECT=149,cinder:INSERT=44,cinder:DELETE=10 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:51:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:42 devstack sudo[103004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info
Jun 29 04:51:42 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:43 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info" returned: 0 in 0.646s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:43 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:51:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:43 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info
Jun 29 04:51:43 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:44 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.info" returned: 0 in 0.627s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.215s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.428s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,created_at=2026-06-29T02:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1007561346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,host='devstack@QuobyteHD#QuobyteHD',id=ed841e71-c015-4f27-adc7-0184d8aa3429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:39Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1197c70-9bb0-48b8-b1c9-241b518b7c1e),volume_type_id=f1197c70-9bb0-48b8-b1c9-241b518b7c1e)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Creating volume ed841e71-c015-4f27-adc7-0184d8aa3429 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:44 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:44 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 1073741824
Jun 29 04:51:44 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1e3753b0-ea5c-4cdb-99bc-102ed005ae6e tempest-GroupSnapshotsTest-1977655564 None] group_snapshot c0a50808-626b-4dc4-91ae-31478494b73c: created successfully
Jun 29 04:51:44 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 1073741824" returned: 0 in 0.843s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:44 devstack sudo[103017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429
Jun 29 04:51:44 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot c0a50808-626b-4dc4-91ae-31478494b73c: deleting
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot c0a50808-626b-4dc4-91ae-31478494b73c: deleting {{(pid=93723) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-38eb20b9-8ab2-4b36-8916-610e50caa56e" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-38eb20b9-8ab2-4b36-8916-610e50caa56e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Deleting offline snapshot 38eb20b9-8ab2-4b36-8916-610e50caa56e of volume 23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] snapshot_file for this snap is: volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257a4db-ac59-4893-a486-56f0a7fd17b0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:45 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429" returned: 0 in 0.672s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.656s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2026136942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f307632-74de-4446-88aa-27c46ce9aaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57675bd5c0e944acbbdbd156acb58e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:36Z,use_quota=True,user_id='5d676a64302144f69d1b2e6b82b09ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Creating volume 6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:45 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:45 devstack sudo[103021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e
Jun 29 04:51:45 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:45 devstack sudo[103022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 1073741824
Jun 29 04:51:45 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da008fae-0671-455c-93d6-c3ac49b482e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed841e71-c015-4f27-adc7-0184d8aa3429', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d0d2c5-2004-4719-9b08-9aa628acaa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Volume volume-ed841e71-c015-4f27-adc7-0184d8aa3429 (ed841e71-c015-4f27-adc7-0184d8aa3429): created successfully
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d0d2c5-2004-4719-9b08-9aa628acaa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (7002b0ba-9af4-4d69-99c5-f47d52fafc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-030f736d-1548-4644-b6b4-5d0d5b8e5b45 tempest-GroupsTest-496889888 None] Created volume successfully.
Jun 29 04:51:46 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e" returned: 0 in 0.812s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dccfff-5002-4263-8956-f6952c373783]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:46 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7
Jun 29 04:51:46 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:46 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 1073741824" returned: 0 in 0.881s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:46 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6
Jun 29 04:51:46 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (1a343d7e-291d-42d1-8ad5-88d700b39c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37bccc6-1156-4738-82ba-3adb7246b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" returned: 0 in 0.813s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37bccc6-1156-4738-82ba-3adb7246b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089731574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,host='devstack@QuobyteHD#QuobyteHD',id=e3681b98-3ff1-4b2b-88de-62a1ad1d21e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:47Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1197c70-9bb0-48b8-b1c9-241b518b7c1e),volume_type_id=f1197c70-9bb0-48b8-b1c9-241b518b7c1e)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec5e72a-2abb-44a7-b888-6fa1eaebd452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack sudo[103047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e
Jun 29 04:51:47 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec5e72a-2abb-44a7-b888-6fa1eaebd452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02ff379-8a90-4143-87b5-5606b92fc152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02ff379-8a90-4143-87b5-5606b92fc152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3681b98-3ff1-4b2b-88de-62a1ad1d21e9', 'volume_name': 'volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e386206b-6972-4120-b264-de3a12144396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e386206b-6972-4120-b264-de3a12144396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058ce736-3c0d-4536-b84b-4f04470d45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Volume e3681b98-3ff1-4b2b-88de-62a1ad1d21e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9', 'volume_size': 1}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:47 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6" returned: 0 in 0.759s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.884s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-993055647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5d753b-41ae-4156-b99a-826d8d94ef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1145df72fe1b4bb7850e597fbb3d7e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:38Z,use_quota=True,user_id='b9e947df1864486785a29ab0ec953c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Creating volume ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:47 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc418fc-f9a7-4741-99f0-764f05bc0283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f307632-74de-4446-88aa-27c46ce9aaf6', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87483d97-3610-4159-ac19-87eea3ffc6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:47 devstack sudo[103049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1073741824
Jun 29 04:51:47 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Volume volume-6f307632-74de-4446-88aa-27c46ce9aaf6 (6f307632-74de-4446-88aa-27c46ce9aaf6): created successfully
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87483d97-3610-4159-ac19-87eea3ffc6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (210a1204-40fb-4c0a-b8bc-fb6379fa190e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b2227517-f3bc-448f-90fd-1394e9043e5a tempest-VolumesDeleteCascade-1831349382 None] Created volume successfully.
Jun 29 04:51:47 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:47 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e
Jun 29 04:51:47 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:48 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1073741824" returned: 0 in 0.843s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:48 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:51:48 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:48 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7.38eb20b9-8ab2-4b36-8916-610e50caa56e" returned: 0 in 0.678s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-38eb20b9-8ab2-4b36-8916-610e50caa56e" released by "_delete_snapshot" :: held 3.182s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" released by "delete_snapshot" :: held 3.214s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-87b58dee-8a77-4ccf-8d0c-41985f6b9f47" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-87b58dee-8a77-4ccf-8d0c-41985f6b9f47" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Deleting offline snapshot 87b58dee-8a77-4ccf-8d0c-41985f6b9f47 of volume d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] snapshot_file for this snap is: volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a1dfc4-51bd-4a31-b5dc-29d6f2d9f4a7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:48 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 0.701s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,created_at=2026-06-29T02:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089731574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b2c5e76-dc3c-4233-b5ae-72fb1a1bf56f,host='devstack@QuobyteHD#QuobyteHD',id=e3681b98-3ff1-4b2b-88de-62a1ad1d21e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d92f070cbc74bb79f57f184cbb24456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:51:47Z,use_quota=True,user_id='b10364df4d0346e98502cf1fd5ab20bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1197c70-9bb0-48b8-b1c9-241b518b7c1e),volume_type_id=f1197c70-9bb0-48b8-b1c9-241b518b7c1e)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Creating volume e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:51:48 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:48 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47
Jun 29 04:51:48 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:48 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 1073741824
Jun 29 04:51:48 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:48 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Attempting download of 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume ee5d753b-41ae-4156-b99a-826d8d94ef2c. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ccdb6-9264-4946-995a-77cde339d82c]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:49 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse
Jun 29 04:51:49 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:49 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47" returned: 0 in 0.839s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a36ad-b1f3-42bb-9d99-8fe22ee321e4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:49 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b
Jun 29 04:51:49 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:49 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 1073741824" returned: 0 in 0.904s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:49 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9
Jun 29 04:51:49 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:49 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse" returned: 0 in 0.870s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:50 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse
Jun 29 04:51:50 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:50 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:50 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" returned: 0 in 0.670s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.761s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" returned: 0 in 0.854s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Creating offline snapshot d747d746-e091-400e-9229-fd7d75898ba2 of volume 6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:51:50 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47
Jun 29 04:51:50 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058ce736-3c0d-4536-b84b-4f04470d45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b983360-fec1-4e59-8ad6-1da50cba35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19cd4d7-f5e0-4343-8216-3ac5555f7496]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Volume volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 (e3681b98-3ff1-4b2b-88de-62a1ad1d21e9): created successfully
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b983360-fec1-4e59-8ad6-1da50cba35d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Flow 'volume_create_manager' (1a343d7e-291d-42d1-8ad5-88d700b39c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:50 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dcd87442-101b-4759-be66-9c6091ddc0fb tempest-GroupsTest-496889888 None] Created volume successfully.
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse" returned: 1 in 0.779s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_bdc_quse' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd90d7-478f-4fb2-92f1-3b762ae276aa]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:50 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6
Jun 29 04:51:50 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:50 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD
Jun 29 04:51:50 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-14c288ae-c1a9-4434-b9e6-2fdedd45c514 tempest-GroupsTest-496889888 None] Update group completed successfully.
Jun 29 04:51:51 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47" returned: 0 in 0.765s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:51 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47
Jun 29 04:51:51 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:51 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6" returned: 0 in 0.937s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:51 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] 715ee343-4947-44c8-82ac-b52ccc04493d was qcow2, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 04:51:51 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 1G
Jun 29 04:51:51 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:51 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:51:51 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:52 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b.87b58dee-8a77-4ccf-8d0c-41985f6b9f47" returned: 0 in 0.706s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-87b58dee-8a77-4ccf-8d0c-41985f6b9f47" released by "_delete_snapshot" :: held 3.284s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" released by "delete_snapshot" :: held 3.324s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:52 devstack cinder-volume[93723]: WARNING cinder.quota [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1972993682 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1972993682, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:52 devstack cinder-volume[93723]: WARNING cinder.quota [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1972993682 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1972993682, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['1fdeb93c-a97a-4e7b-a019-e6b25f52da49', '209f3629-22ab-4697-87ca-5adffd06378a', 'd80d7df0-8029-4ec0-b744-82e1e5c16323', 'd2b2382f-557c-4f87-9643-6230a6a3b394'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['c3923bba-2d24-4a86-9d43-552f66b5af1c', '3fd638a9-d1b7-4048-9e66-86b89fa5a1ff', '2c566e5d-c792-4ba5-a0f8-f0abf764d044', 'dd80834d-4877-4817-84ef-b0314e4b57d8'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:52 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 1G" returned: 0 in 0.910s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:52 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:51:52 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3cd4cd04-5aa8-42c7-884c-871a41129c11 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot c0a50808-626b-4dc4-91ae-31478494b73c: deleted successfully
Jun 29 04:51:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-aea13019-fb1e-43b8-898b-c188677a204a tempest-GroupsTest-496889888 None] Update group completed successfully.
Jun 29 04:51:53 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.778s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:53 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 is being set with open permissions: ugo+rw
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:53 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:51:53 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:53 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 2.122s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_lsk9pmozdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:51:53 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Converted 112.00 MB image at 52.66 MB/s
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[485bd7e7-bad5-4a9d-8c3d-632efe899405]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:53 devstack sudo[103135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1G
Jun 29 04:51:53 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:53 devstack sudo[103136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7
Jun 29 04:51:53 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:54 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:54 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info
Jun 29 04:51:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Acquiring lock "cinder-quobyte-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d659b17-d8b5-424d-a6f6-da9bd3239269]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:54 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9
Jun 29 04:51:54 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:54 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" returned: 0 in 0.881s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:54 devstack sudo[103151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7
Jun 29 04:51:54 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:54 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 1G" returned: 0 in 0.971s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8979f97-d6ef-4520-aef6-7c3c0362365b]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:54 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:51:54 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:54 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:54 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info is being set with open permissions: ugo+rw
Jun 29 04:51:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:55 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info
Jun 29 04:51:55 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:55 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:55 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" returned: 0 in 0.792s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:55 devstack sudo[103163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9
Jun 29 04:51:55 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-23a5f09e-7ea8-4418-b4a4-f3f7ffcf16e7" released by "delete_volume" :: held 1.795s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe53ac-1f60-4a04-8e83-b63a5a18649a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:55 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 0.859s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:55 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b
Jun 29 04:51:55 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:55 devstack sudo[103169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:51:55 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:55 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.info" returned: 0 in 0.728s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.200s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3f537a99-9e34-402a-a4e3-5ffade30dd20 tempest-VolumesDeleteCascade-1831349382 None] Create snapshot completed successfully
Jun 29 04:51:56 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" returned: 0 in 0.710s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-e3681b98-3ff1-4b2b-88de-62a1ad1d21e9" released by "delete_volume" :: held 1.782s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Acquiring lock "cinder-quobyte-ed841e71-c015-4f27-adc7-0184d8aa3429" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-ed841e71-c015-4f27-adc7-0184d8aa3429" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[995740ed-f4d6-4846-966e-0cb0d07232a8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:56 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429
Jun 29 04:51:56 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Creating offline snapshot 71367ddb-a6ab-4619-a6ab-d38bd5e81845 of volume 6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55cdef-5f7d-4671-9c97-0cee0426a738]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:56 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" returned: 0 in 0.961s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:56 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 1 in 0.915s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Downloaded image 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume ee5d753b-41ae-4156-b99a-826d8d94ef2c successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 04:51:56 devstack sudo[103182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d for user b9e947df1864486785a29ab0ec953c0a is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Marking volume ee5d753b-41ae-4156-b99a-826d8d94ef2c as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 04:51:56 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Copying metadata from image 715ee343-4947-44c8-82ac-b52ccc04493d to ee5d753b-41ae-4156-b99a-826d8d94ef2c. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Creating volume glance metadata for volume ee5d753b-41ae-4156-b99a-826d8d94ef2c backed by image 715ee343-4947-44c8-82ac-b52ccc04493d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 04:51:56 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:51:56 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d7e772-1942-4068-a18d-36bc258120c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872e694f0>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fa420-4170-45c1-a1d2-997f99a61251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:51:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Volume volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c (ee5d753b-41ae-4156-b99a-826d8d94ef2c): created successfully
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561fa420-4170-45c1-a1d2-997f99a61251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:51:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Flow 'volume_create_manager' (5a0933e2-968a-45f2-b544-f3b275c8ba73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:51:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5165b92e-4791-4bc3-8f12-e1b27aea202e tempest-VolumesExtendTest-588036459 None] Created volume successfully.
Jun 29 04:51:57 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:57 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429
Jun 29 04:51:57 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:57 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" returned: 0 in 0.690s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-d4f805f5-63ee-4952-bd38-0a9b7f2a866b" released by "delete_volume" :: held 1.721s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['4914ea20-1668-4999-9ce0-0b24e671c36a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:57 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.857s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f307632-74de-4446-88aa-27c46ce9aaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:57 devstack cinder-volume[93723]: WARNING cinder.quota [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1972993682 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1972993682, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:57 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 1G
Jun 29 04:51:57 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['97b6757e-a3c8-431f-9b95-ea33613a040a', '96dfe3be-a470-43c4-a5c3-9327adf1de9f', '1dcf5269-0cd8-4492-8330-095c16ba8b65', '025b8dba-ef0f-458f-b2b8-fc81ab35bdd4'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['54f1c8c5-a9fc-43b4-9c8d-d92428d01dc4', 'efb9eb93-edf6-4021-bc30-9665ade81f34', 'd5e2f7da-27af-48a3-88b8-097783d48236', '062bdaa2-7b80-4e4f-966f-909f61d885ba'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:57 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:57 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:57 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ed841e71-c015-4f27-adc7-0184d8aa3429" returned: 0 in 0.775s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "cinder-quobyte-ed841e71-c015-4f27-adc7-0184d8aa3429" released by "delete_volume" :: held 1.744s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:51:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Created reservations ['b5c78113-9d58-40c6-b50b-06c1f7012e7d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:57 devstack cinder-volume[93723]: WARNING cinder.quota [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1341941661 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1341941661, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:57 devstack cinder-volume[93723]: WARNING cinder.quota [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1341941661 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1341941661, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Created reservations ['9cd9c841-b9bd-4187-807a-049eeed9933e', '52007770-6fa4-4f6a-9830-33698fe52faa', '62faee4b-18a6-4b9d-88ec-1917f9498e71', '08cde199-306e-43ec-9de8-e3818975f580'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Created reservations ['7ff0bcd0-3818-4cf1-b99b-94770fec53f6', '670b0ad0-0c32-442f-b6ee-d167b8ccfae1', 'd3d482ef-617f-4c71-8bcf-c8f97386152e', '267d6701-6d7b-4212-b98d-e43e81b73166'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:58 devstack sudo[103205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:51:58 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:58 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 1G" returned: 0 in 0.999s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:58 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:58 devstack sudo[103207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.691s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:58 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-65c8e59a-5d3e-4d7d-b324-8ff6dbc17461 tempest-GroupSnapshotsTest-1977655564 None] Delete group completed successfully.
Jun 29 04:51:58 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.707s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:51:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fd0518b9-8dec-4b0d-868e-1b6547aa928b tempest-GroupsTest-496889888 None] Delete group completed successfully.
Jun 29 04:51:59 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:59 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 is being set with open permissions: ugo+rw
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:59 devstack sudo[103214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845
Jun 29 04:51:59 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:51:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-671e3d0c-b3f1-4190-99a6-4ae7fdc162ec tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-1895441325: creating
Jun 29 04:51:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-671e3d0c-b3f1-4190-99a6-4ae7fdc162ec tempest-GroupSnapshotsTest-1977655564 None] Group tempest-GroupSnapshotsTest-Group-1895441325: created successfully
Jun 29 04:51:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-671e3d0c-b3f1-4190-99a6-4ae7fdc162ec tempest-GroupSnapshotsTest-1977655564 None] Create group completed successfully.
Jun 29 04:51:59 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845" returned: 0 in 0.676s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.414s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:51:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9a949a77-a4f7-4997-bcdf-d4a9d30d4f78 tempest-VolumesDeleteCascade-1831349382 None] Create snapshot completed successfully
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[4894f96c-f925-4c88-ab3a-d463dae643e7]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:51:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:51:59 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:51:59 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-6f307632-74de-4446-88aa-27c46ce9aaf6-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-6f307632-74de-4446-88aa-27c46ce9aaf6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:00 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 0.912s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Performing cascade delete. {{(pid=93723) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-71367ddb-a6ab-4619-a6ab-d38bd5e81845-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-71367ddb-a6ab-4619-a6ab-d38bd5e81845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:00 devstack sudo[103221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:52:00 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-71367ddb-a6ab-4619-a6ab-d38bd5e81845" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-71367ddb-a6ab-4619-a6ab-d38bd5e81845" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Deleting offline snapshot 71367ddb-a6ab-4619-a6ab-d38bd5e81845 of volume 6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] snapshot_file for this snap is: volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:52:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc714d8-d501-49e4-8926-0ebfdecc48a0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (65b75275-1a18-4c47-a2c8-25a4427ea478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afea07a-8514-413b-8a7a-81dad643b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afea07a-8514-413b-8a7a-81dad643b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1186191218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=139c884c-7b0c-4e72-8a66-b31ad1dae3af,host='devstack@QuobyteHD#QuobyteHD',id=154ad170-8554-4c67-8d1a-bb0982b4de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:01Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29eefb4-0cac-434b-9c0c-0e254fbee693),volume_type_id=f29eefb4-0cac-434b-9c0c-0e254fbee693)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecb19b0-e3f6-4973-bee3-f994035f552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecb19b0-e3f6-4973-bee3-f994035f552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea523b4-2b44-47a9-9242-45d7dff2b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea523b4-2b44-47a9-9242-45d7dff2b063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154ad170-8554-4c67-8d1a-bb0982b4de02', 'volume_name': 'volume-154ad170-8554-4c67-8d1a-bb0982b4de02', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91424e56-bea9-432e-83e2-418e20816061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91424e56-bea9-432e-83e2-418e20816061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab279d0c-e34d-46c5-bf83-1ab6016c99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Volume 154ad170-8554-4c67-8d1a-bb0982b4de02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154ad170-8554-4c67-8d1a-bb0982b4de02', 'volume_size': 1}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:01 devstack sudo[103223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845
Jun 29 04:52:01 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 1 in 0.938s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:52:01 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 2G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c 2G" returned: 0 in 0.085s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.986s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=139c884c-7b0c-4e72-8a66-b31ad1dae3af,created_at=2026-06-29T02:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1186191218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=139c884c-7b0c-4e72-8a66-b31ad1dae3af,host='devstack@QuobyteHD#QuobyteHD',id=154ad170-8554-4c67-8d1a-bb0982b4de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d377ed902dd450ea5e1d8b2a358ba60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:01Z,use_quota=True,user_id='3162a56df5254f938e22cc662d04c464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29eefb4-0cac-434b-9c0c-0e254fbee693),volume_type_id=f29eefb4-0cac-434b-9c0c-0e254fbee693)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Creating volume 154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:01 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:01 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 1073741824
Jun 29 04:52:01 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-421d7d35-4d26-4113-9bc0-adba65dbbdab tempest-VolumesExtendTest-588036459 None] Extend volume completed successfully.
Jun 29 04:52:02 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845" returned: 0 in 1.037s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f307632-74de-4446-88aa-27c46ce9aaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d741fa3-03d3-44da-81e9-d3ecc19765cd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:02 devstack sudo[103237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:52:02 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:02 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 1073741824" returned: 0 in 0.978s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:02 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02
Jun 29 04:52:02 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:02 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.854s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f307632-74de-4446-88aa-27c46ce9aaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:02 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845
Jun 29 04:52:02 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-ee5d753b-41ae-4156-b99a-826d8d94ef2c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "cinder-ee5d753b-41ae-4156-b99a-826d8d94ef2c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-quobyte-ee5d753b-41ae-4156-b99a-826d8d94ef2c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-ee5d753b-41ae-4156-b99a-826d8d94ef2c" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0384657f-8e5b-4a4d-85b7-20b43682ffad]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:03 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:03 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:03 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:52:03 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:03 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02" returned: 0 in 0.867s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab279d0c-e34d-46c5-bf83-1ab6016c99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154ad170-8554-4c67-8d1a-bb0982b4de02', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bad430d-402a-4068-aa00-b0e95cf1def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:03 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Volume volume-154ad170-8554-4c67-8d1a-bb0982b4de02 (154ad170-8554-4c67-8d1a-bb0982b4de02): created successfully
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bad430d-402a-4068-aa00-b0e95cf1def0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Flow 'volume_create_manager' (65b75275-1a18-4c47-a2c8-25a4427ea478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:03 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7b898bb7-a784-4942-a15d-618d75d2c823 tempest-GroupSnapshotsTest-1977655564 None] Created volume successfully.
Jun 29 04:52:03 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845" returned: 0 in 1.048s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:04 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845
Jun 29 04:52:04 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:04 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.858s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:52:04 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 1.029s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:04 devstack sudo[103268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:52:04 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:04 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.71367ddb-a6ab-4619-a6ab-d38bd5e81845" returned: 0 in 0.773s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-71367ddb-a6ab-4619-a6ab-d38bd5e81845" released by "_delete_snapshot" :: held 3.879s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" released by "delete_snapshot" :: held 3.917s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] GroupSnapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: creating.
Jun 29 04:52:04 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['eaee126c-0639-4e4e-8c65-06c74cec5be2', '6f46fa3a-6768-4b13-ae3e-a9bae428f937', '180711be-c8ca-43af-8f52-d6e7d93fc86e', '1d0b36cc-3d68-4ed6-80aa-72fb22e36446'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Group snapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: creating. {{(pid=93723) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Creating offline snapshot 65301894-a6b1-404a-917a-c3ecfe5ba55d of volume 154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747f5a4-0a4e-4e98-8d53-852f8a2ec54c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Delete snapshot completed successfully.
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-71367ddb-a6ab-4619-a6ab-d38bd5e81845-delete_snapshot" released by "delete_snapshot" :: held 4.264s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-d747d746-e091-400e-9229-fd7d75898ba2-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-d747d746-e091-400e-9229-fd7d75898ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-d747d746-e091-400e-9229-fd7d75898ba2" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d747d746-e091-400e-9229-fd7d75898ba2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Deleting offline snapshot d747d746-e091-400e-9229-fd7d75898ba2 of volume 6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] snapshot_file for this snap is: volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcfb227-4287-472c-9ec6-335c695e8907]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:05 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02
Jun 29 04:52:05 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:05 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:52:05 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:05 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 1 in 1.050s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:52:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:05 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c
Jun 29 04:52:05 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:06 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.821s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f307632-74de-4446-88aa-27c46ce9aaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:06 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02" returned: 0 in 1.038s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88f925-772a-4ea6-b848-9735bbcddae6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:06 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d 1G
Jun 29 04:52:06 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:06 devstack sudo[103324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6
Jun 29 04:52:06 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:06 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ee5d753b-41ae-4156-b99a-826d8d94ef2c" returned: 0 in 0.759s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-ee5d753b-41ae-4156-b99a-826d8d94ef2c" released by "delete_volume" :: held 2.950s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Created reservations ['f1d84b17-d8f8-4be1-b5c3-eedf48fbc407', 'f54ec782-ef3e-46ec-9b2e-08217c0ca378', 'dbe72797-6372-465f-8932-3518c8f28679', '4d9e578d-f2b8-41e1-a2aa-93633aea6ff6'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:06 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:06 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:07 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d 1G" returned: 0 in 0.977s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154ad170-8554-4c67-8d1a-bb0982b4de02 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:07 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6" returned: 0 in 1.002s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:07 devstack sudo[103337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154ad170-8554-4c67-8d1a-bb0982b4de02 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d
Jun 29 04:52:07 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:07 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:52:07 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Flow 'volume_create_manager' (2728c54c-dd78-43e8-ac6b-446f9de16e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bb37e2-6989-435d-8e8a-f2ee12f01d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bb37e2-6989-435d-8e8a-f2ee12f01d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1507700533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4dccf8-2251-4a5d-9da1-a1908f5deaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1145df72fe1b4bb7850e597fbb3d7e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:07Z,use_quota=True,user_id='b9e947df1864486785a29ab0ec953c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52937f6-0a8d-400a-b0e7-2d575c9bf7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52937f6-0a8d-400a-b0e7-2d575c9bf7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac90c2-216c-4ca9-91b5-01719c300422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac90c2-216c-4ca9-91b5-01719c300422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4dccf8-2251-4a5d-9da1-a1908f5deaaa', 'volume_name': 'volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d9da78-0f5c-4d8e-8123-de3ace659413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d9da78-0f5c-4d8e-8123-de3ace659413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f41f054-149c-4f07-ab41-ede52fb6f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Volume 0e4dccf8-2251-4a5d-9da1-a1908f5deaaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa', 'volume_size': 1}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:07 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.034s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Deleted volume successfully.
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7421a9ca-03c5-47dc-8f76-53d8a382075b tempest-VolumesExtendTest-588036459 None] Lock "cinder-ee5d753b-41ae-4156-b99a-826d8d94ef2c-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:07 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.848s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:07 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154ad170-8554-4c67-8d1a-bb0982b4de02 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d" returned: 0 in 0.895s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:07 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:52:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:08 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2
Jun 29 04:52:08 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:08 devstack sudo[103350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d
Jun 29 04:52:08 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:08 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6.d747d746-e091-400e-9229-fd7d75898ba2" returned: 0 in 0.646s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:08 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d" returned: 0 in 0.657s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d747d746-e091-400e-9229-fd7d75898ba2" released by "_delete_snapshot" :: held 3.446s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" released by "delete_snapshot" :: held 3.474s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:08 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info
Jun 29 04:52:08 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['4b63849d-f3be-41af-a36d-6e828220bd24', 'b0365827-7192-4b35-98ed-ea889c4350dc', 'a1b90e34-9a2e-40ba-a349-d03402294194', 'ed4db2ab-63a7-4aff-a371-ea09bc5f1f3e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Delete snapshot completed successfully.
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-d747d746-e091-400e-9229-fd7d75898ba2-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Snapshots deleted, issuing volume delete {{(pid=93723) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c52cd9-8dc6-445a-b0ed-d4bab641c631]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:09 devstack sudo[103357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6
Jun 29 04:52:09 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:09 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info" returned: 0 in 0.681s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:09 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 29 04:52:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:09 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info
Jun 29 04:52:09 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:09 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6" returned: 0 in 0.840s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:09 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6
Jun 29 04:52:09 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:10 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.info" returned: 0 in 0.674s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.042s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.625s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1507700533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4dccf8-2251-4a5d-9da1-a1908f5deaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1145df72fe1b4bb7850e597fbb3d7e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:07Z,use_quota=True,user_id='b9e947df1864486785a29ab0ec953c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Creating volume 0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:10 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:10 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa 1073741824
Jun 29 04:52:10 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d8436cec-ff37-4045-a42c-97400fbf99f0 tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: created successfully
Jun 29 04:52:10 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6f307632-74de-4446-88aa-27c46ce9aaf6" returned: 0 in 0.783s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-6f307632-74de-4446-88aa-27c46ce9aaf6" released by "delete_volume" :: held 1.714s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: deleting
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: deleting {{(pid=93723) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['df6c477b-4764-4028-8c49-6112832ac3aa', 'cf201453-0879-4295-906e-007b7742ff61', 'd6dd959a-33f0-46d0-bba0-0f105b2f6621', 'f1200484-7149-4a8d-a7db-d88857111602'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-65301894-a6b1-404a-917a-c3ecfe5ba55d" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-65301894-a6b1-404a-917a-c3ecfe5ba55d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Deleting offline snapshot 65301894-a6b1-404a-917a-c3ecfe5ba55d of volume 154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] snapshot_file for this snap is: volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81d93a4-ad54-479a-bfcd-45ec2134a61f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:10 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:10 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:10 devstack sudo[103374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d
Jun 29 04:52:11 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:11 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa 1073741824" returned: 0 in 1.075s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:11 devstack sudo[103380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:11 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:11 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.919s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Deleted volume successfully.
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7a4671fb-96c4-4670-bb0b-003c6659de85 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-6f307632-74de-4446-88aa-27c46ce9aaf6-delete_volume" released by "delete_volume" :: held 11.177s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:11 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d" returned: 0 in 1.100s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154ad170-8554-4c67-8d1a-bb0982b4de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d791be-9cc2-495e-ab50-d01dba6a96cc]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:12 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02
Jun 29 04:52:12 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:12 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 0.907s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f41f054-149c-4f07-ab41-ede52fb6f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac0a283-f7b9-44bb-b25b-926c431b917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Volume volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa (0e4dccf8-2251-4a5d-9da1-a1908f5deaaa): created successfully
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac0a283-f7b9-44bb-b25b-926c431b917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Flow 'volume_create_manager' (2728c54c-dd78-43e8-ac6b-446f9de16e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-39b1f26f-dde6-441e-8481-12a1d1b87bf4 tempest-VolumesExtendTest-588036459 None] Created volume successfully.
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (e08f33c3-24a8-4d33-aca1-7ca30e170418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca42284e-d970-4223-a9d2-14bd73414d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca42284e-d970-4223-a9d2-14bd73414d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-947133085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d242ccf2-b196-4723-87ca-5a5e55269637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57675bd5c0e944acbbdbd156acb58e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:12Z,use_quota=True,user_id='5d676a64302144f69d1b2e6b82b09ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683da204-9b4a-472d-9d29-b1ff6333bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683da204-9b4a-472d-9d29-b1ff6333bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e46a7-6378-4fd2-b496-1be8d6751ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2e46a7-6378-4fd2-b496-1be8d6751ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd242ccf2-b196-4723-87ca-5a5e55269637', 'volume_name': 'volume-d242ccf2-b196-4723-87ca-5a5e55269637', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ea4869-39a8-464e-98f2-ae0a1379df65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ea4869-39a8-464e-98f2-ae0a1379df65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe1bbc2-cc6f-4b5c-8a9c-029773bf4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Volume d242ccf2-b196-4723-87ca-5a5e55269637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d242ccf2-b196-4723-87ca-5a5e55269637', 'volume_size': 1}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-947133085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d242ccf2-b196-4723-87ca-5a5e55269637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57675bd5c0e944acbbdbd156acb58e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:12Z,use_quota=True,user_id='5d676a64302144f69d1b2e6b82b09ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Creating volume d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:12 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 1073741824
Jun 29 04:52:12 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:12 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02" returned: 0 in 1.025s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:13 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d
Jun 29 04:52:13 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:13 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 1073741824" returned: 0 in 0.991s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:13 devstack sudo[103401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:13 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:13 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d" returned: 0 in 0.841s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:13 devstack sudo[103406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d
Jun 29 04:52:13 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:14 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 0.700s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.251s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe1bbc2-cc6f-4b5c-8a9c-029773bf4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d242ccf2-b196-4723-87ca-5a5e55269637', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c143e-58f3-4211-981e-b1c748ab7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Creating offline snapshot 64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 of volume 0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:52:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Volume volume-d242ccf2-b196-4723-87ca-5a5e55269637 (d242ccf2-b196-4723-87ca-5a5e55269637): created successfully
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227c143e-58f3-4211-981e-b1c748ab7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (e08f33c3-24a8-4d33-aca1-7ca30e170418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccb5216-7e68-4ff2-83a6-93ad286f975a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f0c4807a-fb8d-491c-8d00-b3d7d82a3971 tempest-VolumesDeleteCascade-1831349382 None] Created volume successfully.
Jun 29 04:52:14 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:14 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:14 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02.65301894-a6b1-404a-917a-c3ecfe5ba55d" returned: 0 in 0.712s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-65301894-a6b1-404a-917a-c3ecfe5ba55d" released by "_delete_snapshot" :: held 3.845s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" released by "delete_snapshot" :: held 3.891s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:14 devstack cinder-volume[93723]: WARNING cinder.quota [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1458727140 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1458727140, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:52:14 devstack cinder-volume[93723]: WARNING cinder.quota [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1458727140 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1458727140, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['1807da67-dd76-4c3c-ba95-5ce593814823', '9629ced7-2ae5-4b83-a626-54621d0dab36', 'c1da5e16-3373-42b2-bb1b-fc43c74b3641', '98a217a4-d701-419e-8269-f17ea5294830'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-18d31d72-be10-4088-8ea7-a14d8d59e8cf tempest-GroupSnapshotsTest-1977655564 None] group_snapshot 6e134e0f-31a7-45d0-b6ff-b827053a18e6: deleted successfully
Jun 29 04:52:15 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 0.907s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:15 devstack sudo[103416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 1G
Jun 29 04:52:15 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adf6176-a7c3-42f6-93eb-323c67166ce2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:15 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02
Jun 29 04:52:15 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:16 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 1G" returned: 0 in 0.992s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:16 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11
Jun 29 04:52:16 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:16 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:16 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02
Jun 29 04:52:16 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:17 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" returned: 0 in 0.886s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:17 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 is being set with open permissions: ugo+rw
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:17 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11
Jun 29 04:52:17 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:17 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-154ad170-8554-4c67-8d1a-bb0982b4de02" returned: 0 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Lock "cinder-quobyte-154ad170-8554-4c67-8d1a-bb0982b4de02" released by "delete_volume" :: held 1.814s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['dc49127b-2b7a-4d9a-8818-adaf26389017'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:17 devstack cinder-volume[93723]: WARNING cinder.quota [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1458727140 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1458727140, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Created reservations ['cf5949f8-651e-4060-93cf-e43028b6cfa9', '85d3a563-9a1b-4f28-a93f-1c71dcb186cd', '353aa665-b04b-402a-b68c-1db75a2c5f04', 'a830dc8e-1322-43ba-ba7a-96d53a451cef'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:17 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:17 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:17 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" returned: 0 in 0.689s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:17 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info
Jun 29 04:52:17 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:18 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.765s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:18 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:18 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-398c7eda-b589-4a43-8be3-8f8902744465 tempest-GroupSnapshotsTest-1977655564 None] Delete group completed successfully.
Jun 29 04:52:18 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info" returned: 0 in 0.771s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:18 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info is being set with open permissions: ugo+rw
Jun 29 04:52:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:18 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info
Jun 29 04:52:18 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:19 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.info" returned: 0 in 0.769s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.168s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.677s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Creating offline snapshot 47fc5931-cf86-41c2-9681-0a97f50576fa of volume d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e7633-bf10-4980-b966-96fdcff51d88]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c79a2f20-f772-436c-b4c9-df83965baf9f tempest-VolumesExtendTest-588036459 None] Create snapshot completed successfully
Jun 29 04:52:19 devstack sudo[103446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:19 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:20 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 0.905s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:20 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa 1G
Jun 29 04:52:20 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:21 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa 1G" returned: 0 in 0.879s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d242ccf2-b196-4723-87ca-5a5e55269637 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:21 devstack sudo[103458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d242ccf2-b196-4723-87ca-5a5e55269637 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:21 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:22 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d242ccf2-b196-4723-87ca-5a5e55269637 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:22 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa is being set with open permissions: ugo+rw
Jun 29 04:52:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:22 devstack sudo[103464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:22 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:22 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 0.736s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:22 devstack sudo[103467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info
Jun 29 04:52:22 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:23 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info" returned: 0 in 0.776s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:23 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info is being set with open permissions: ugo+rw
Jun 29 04:52:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:23 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info
Jun 29 04:52:23 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:24 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.info" returned: 0 in 0.822s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:24 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddb78c-df87-4598-9f0a-64b22c368940]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-845ad536-1291-4f26-b5df-6ab0a7585336 tempest-VolumesDeleteCascade-1831349382 None] Create snapshot completed successfully
Jun 29 04:52:24 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:24 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:25 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 0.876s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 2G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 2G" returned: 0 in 0.194s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.116s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7d83f67c-7f45-45a0-8f37-c05e0529e7be tempest-VolumesExtendTest-588036459 None] Extend volume completed successfully.
Jun 29 04:52:25 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (8ba91178-b942-44c5-8476-d0ba85b527f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c0911d-3aee-4dd1-9df6-d631ed512c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c0911d-3aee-4dd1-9df6-d631ed512c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-701365677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516995f4-9e66-4325-8edf-95291a08545f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57675bd5c0e944acbbdbd156acb58e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47fc5931-cf86-41c2-9681-0a97f50576fa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:26Z,use_quota=True,user_id='5d676a64302144f69d1b2e6b82b09ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e855c37-101b-4b54-a1be-99774d494f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e855c37-101b-4b54-a1be-99774d494f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6d09f-e674-4fe5-bf52-3eceacc91826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6d09f-e674-4fe5-bf52-3eceacc91826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '516995f4-9e66-4325-8edf-95291a08545f', 'volume_name': 'volume-516995f4-9e66-4325-8edf-95291a08545f', 'volume_size': 1, 'snapshot_id': '47fc5931-cf86-41c2-9681-0a97f50576fa'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e924ac7-0bd4-4f97-b84e-c3792d5ce1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e924ac7-0bd4-4f97-b84e-c3792d5ce1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904083df-5893-491e-af9f-1c6773e6bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Volume 516995f4-9e66-4325-8edf-95291a08545f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-516995f4-9e66-4325-8edf-95291a08545f', 'volume_size': 1, 'snapshot_id': '47fc5931-cf86-41c2-9681-0a97f50576fa'}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa-516995f4-9e66-4325-8edf-95291a08545f" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa-516995f4-9e66-4325-8edf-95291a08545f" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Creating volume 516995f4-9e66-4325-8edf-95291a08545f from snapshot 47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" acquired by "delete_snapshot" :: waited 0.056s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-quobyte-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] snapshot: 47fc5931-cf86-41c2-9681-0a97f50576fa, volume: 516995f4-9e66-4325-8edf-95291a08545f,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Deleting offline snapshot 64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 of volume 0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] snapshot_file for this snap is: volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e41bf3-b1c1-4ea6-858d-f69a3fe9d42e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff37e6-9b23-4f11-8f2b-7d0659560e1d]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:26 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:26 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:26 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11
Jun 29 04:52:26 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:27 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" returned: 0 in 1.037s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:27 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 1.047s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d242ccf2-b196-4723-87ca-5a5e55269637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210e7ce-ad2a-42bc-b9d0-edc9bedcddcd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6450a4-2c42-494f-80bc-da38b1834a13]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:27 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:27 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:27 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:27 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:28 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 0.948s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:28 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11
Jun 29 04:52:28 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:28 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 1.005s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:28 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:52:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:28 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f
Jun 29 04:52:28 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:29 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" returned: 0 in 0.867s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:29 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11
Jun 29 04:52:29 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Flow 'volume_create_manager' (c4d6ddc6-3cf8-4540-b965-0a2bf8710694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4953b591-090a-4b93-b807-8d57bb4796b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4953b591-090a-4b93-b807-8d57bb4796b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1212222147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d85d6f2-ef83-49bd-9f7a-53f5635bb714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f00483582446a183b4594332fb46fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:30Z,use_quota=True,user_id='8ddbb99277e74382906fd488c932e0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190c6a1e-bf3b-40e2-8a29-9b9d3012d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190c6a1e-bf3b-40e2-8a29-9b9d3012d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761909d1-3771-4c88-bcd2-14b2e5163339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761909d1-3771-4c88-bcd2-14b2e5163339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d85d6f2-ef83-49bd-9f7a-53f5635bb714', 'volume_name': 'volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de68e59-39e3-4139-91ab-ee89c071c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de68e59-39e3-4139-91ab-ee89c071c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d542f4d-bfcb-4021-84e6-069f5a25317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:29 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume 9d85d6f2-ef83-49bd-9f7a-53f5635bb714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714', 'volume_size': 1}
Jun 29 04:52:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:30 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa.64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" returned: 0 in 1.349s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11" released by "_delete_snapshot" :: held 4.406s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" released by "delete_snapshot" :: held 4.460s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:30 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Created reservations ['7edc8fb7-5897-4f1e-83b8-8b43d933446d', 'fd27cc29-a589-48a5-a523-5634e7b52174', '92493d2d-d718-430b-ba4a-13a10fd86667', '52823d81-2e85-4afc-a76f-bf28930e13d5'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Delete snapshot completed successfully.
Jun 29 04:52:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e72d05-6477-4ca2-88d0-f1e6f54f46cb tempest-VolumesExtendTest-588036459 None] Lock "cinder-64f8a3c7-5ffa-4ef9-84d0-7d238b434f11-delete_snapshot" released by "delete_snapshot" :: held 4.824s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5d0eaeb5-a7f6-4a2c-9f8f-d9e92495a169 tempest-GroupsV320Test-802497991 None] Group tempest-GroupsV320Test-Group-1992420595: creating
Jun 29 04:52:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5d0eaeb5-a7f6-4a2c-9f8f-d9e92495a169 tempest-GroupsV320Test-802497991 None] Group tempest-GroupsV320Test-Group-1992420595: created successfully
Jun 29 04:52:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5d0eaeb5-a7f6-4a2c-9f8f-d9e92495a169 tempest-GroupsV320Test-802497991 None] Create group completed successfully.
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "cinder-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Acquiring lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f028f30-718f-48e3-9f96-d747047d3d13]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:32 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:32 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Created reservations ['db798554-45a8-41df-aa72-8018368a5938'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:33 devstack sudo[103529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:33 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:34 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.078s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c5db52b3-87e5-4f8a-b4a5-47ae2fa810bd tempest-GroupsV320Test-802497991 None] Delete group completed successfully.
Jun 29 04:52:34 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 2.644s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:34 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa
Jun 29 04:52:34 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:34 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f" returned: 0 in 6.161s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[51497acc-ac11-4d0c-afd7-1f542e814e59]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:34 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:34 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:35 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" returned: 0 in 0.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "cinder-quobyte-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa" released by "delete_volume" :: held 3.429s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Created reservations ['0f328274-88eb-4c7d-bd46-2e47d39aa75e', 'd03e905c-bb32-4def-b4e9-938a58aa5ef4', '4075173e-5daa-4601-972b-4ba410d0ebe3', 'c53350f6-a006-48f0-909f-eb18cd8e8b6d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:35 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:35 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 1.033s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:52:35 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:35 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Converted 1024.00 MB image at 166.18 MB/s
Jun 29 04:52:35 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f is being set with open permissions: ugo+rw
Jun 29 04:52:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:35 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f
Jun 29 04:52:35 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:36 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.725s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Deleted volume successfully.
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82251d22-736c-4b06-9bec-e0c3238a50ef tempest-VolumesExtendTest-588036459 None] Lock "cinder-0e4dccf8-2251-4a5d-9da1-a1908f5deaaa-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:36 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f" returned: 0 in 0.713s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" released by "_copy_volume_from_snapshot" :: held 10.129s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa-516995f4-9e66-4325-8edf-95291a08545f" released by "_create_volume_from_snapshot" :: held 10.179s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.216s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.409s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1212222147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d85d6f2-ef83-49bd-9f7a-53f5635bb714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f00483582446a183b4594332fb46fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:30Z,use_quota=True,user_id='8ddbb99277e74382906fd488c932e0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Creating volume 9d85d6f2-ef83-49bd-9f7a-53f5635bb714 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:36 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:36 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 1073741824
Jun 29 04:52:36 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904083df-5893-491e-af9f-1c6773e6bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516995f4-9e66-4325-8edf-95291a08545f', 'volume_size': 1, 'snapshot_id': '47fc5931-cf86-41c2-9681-0a97f50576fa'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8045a17e-a625-488b-8415-a136567fad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:36 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Volume volume-516995f4-9e66-4325-8edf-95291a08545f (516995f4-9e66-4325-8edf-95291a08545f): created successfully
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8045a17e-a625-488b-8415-a136567fad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Flow 'volume_create_manager' (8ba91178-b942-44c5-8476-d0ba85b527f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-27d0ea33-0d9f-49f2-bf4f-9f452f99c140 tempest-VolumesDeleteCascade-1831349382 None] Created volume successfully.
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-d242ccf2-b196-4723-87ca-5a5e55269637-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-d242ccf2-b196-4723-87ca-5a5e55269637-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Performing cascade delete. {{(pid=93723) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-47fc5931-cf86-41c2-9681-0a97f50576fa-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-47fc5931-cf86-41c2-9681-0a97f50576fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Deleting offline snapshot 47fc5931-cf86-41c2-9681-0a97f50576fa of volume d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] snapshot_file for this snap is: volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1930225a-6b4e-4399-afa7-debfb67dc838]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:37 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 1073741824" returned: 0 in 1.207s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:37 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:37 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:37 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714
Jun 29 04:52:37 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:38 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d542f4d-bfcb-4021-84e6-069f5a25317d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7594e5b4-bab4-4e8e-95c4-9e510810af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:38 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 (9d85d6f2-ef83-49bd-9f7a-53f5635bb714): created successfully
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7594e5b4-bab4-4e8e-95c4-9e510810af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Flow 'volume_create_manager' (c4d6ddc6-3cf8-4540-b965-0a2bf8710694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 0.962s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d242ccf2-b196-4723-87ca-5a5e55269637(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:52:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e5d9b8d7-6e09-44b1-8dd6-a76884f5b7f6 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Created volume successfully.
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b740013-d1cd-43ea-80df-fbb296e81934]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:38 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:38 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "cinder-9d85d6f2-ef83-49bd-9f7a-53f5635bb714-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "cinder-9d85d6f2-ef83-49bd-9f7a-53f5635bb714-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "cinder-quobyte-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "cinder-quobyte-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc19be2-639a-4b36-91d1-97e52c6154dd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:38 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714
Jun 29 04:52:38 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:39 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 0.961s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:39 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:39 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:39 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" returned: 0 in 0.960s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:39 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714
Jun 29 04:52:39 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (87584076-440a-436d-a730-56e71bda127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18e77f2-faeb-4fd0-889e-bac6bf513f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18e77f2-faeb-4fd0-889e-bac6bf513f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-476299091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e5b50a-d7d5-4715-8da0-afd0cbc02f7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:40Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea08ca-d81e-4d49-88a1-509ba1ce8216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea08ca-d81e-4d49-88a1-509ba1ce8216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa0867e-92ac-415e-8725-cf44883d608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa0867e-92ac-415e-8725-cf44883d608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e5b50a-d7d5-4715-8da0-afd0cbc02f7e', 'volume_name': 'volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e51f2bd-1618-4ab3-b5c0-2dbd1d4c6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e51f2bd-1618-4ab3-b5c0-2dbd1d4c6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3247b571-69b9-40a6-aec2-3abf5ed3f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Volume 61e5b50a-d7d5-4715-8da0-afd0cbc02f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e', 'volume_size': 1}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-476299091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e5b50a-d7d5-4715-8da0-afd0cbc02f7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:40Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Creating volume 61e5b50a-d7d5-4715-8da0-afd0cbc02f7e {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:40 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:40 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 0.930s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:40 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e 1073741824
Jun 29 04:52:40 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:40 devstack sudo[103585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa
Jun 29 04:52:40 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:40 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" returned: 0 in 0.823s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "cinder-quobyte-9d85d6f2-ef83-49bd-9f7a-53f5635bb714" released by "delete_volume" :: held 1.851s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Created reservations ['49d5faa9-b873-49b9-b190-33ab4e06db2f', '365b735b-d783-4bc9-9085-1bd7249d2d24', '0db940cb-ac54-4612-bff0-8dfcf1c65cef', '7b3c4719-2f72-4df0-a94f-7e102476cb91'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Flow 'volume_create_manager' (48f56a1e-1028-46d7-b8d3-ff95f5f98899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:40 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:40 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9e5c4-38b7-4777-a89a-085de755733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9e5c4-38b7-4777-a89a-085de755733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1651653615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9c100c-534b-4366-92fe-dcbbb3345d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b953eced11fe4bf7ba15f6014eec831a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:41Z,use_quota=True,user_id='5c15233f261a44009e379aae26978763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcd3f0c-5d06-4a41-9a9c-a70b3501be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcd3f0c-5d06-4a41-9a9c-a70b3501be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3587a060-2b46-480a-8b4d-c482a24074b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3587a060-2b46-480a-8b4d-c482a24074b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9c100c-534b-4366-92fe-dcbbb3345d45', 'volume_name': 'volume-7e9c100c-534b-4366-92fe-dcbbb3345d45', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16eb7c8-4a7e-4c8d-84c5-121f7f87d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16eb7c8-4a7e-4c8d-84c5-121f7f87d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfba71aa-a127-486f-9080-ff23d5a9446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Volume 7e9c100c-534b-4366-92fe-dcbbb3345d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9c100c-534b-4366-92fe-dcbbb3345d45', 'volume_size': 1}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:41 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637.47fc5931-cf86-41c2-9681-0a97f50576fa" returned: 0 in 0.796s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-47fc5931-cf86-41c2-9681-0a97f50576fa" released by "_delete_snapshot" :: held 3.767s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" released by "delete_snapshot" :: held 3.806s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['12a16511-0832-4cf3-abce-0d5f5cd312e7', 'aad99ca3-1f11-4f68-9a8f-267440e107b9', 'fbabb333-ef30-47d8-b5a8-abe6e0efdfcc', 'a1c28aea-7a13-4a82-9c16-74b5392ea9e7'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Delete snapshot completed successfully.
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-47fc5931-cf86-41c2-9681-0a97f50576fa-delete_snapshot" released by "delete_snapshot" :: held 4.070s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Snapshots deleted, issuing volume delete {{(pid=93723) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8513a39a-0414-4461-b414-b8fca9fde4c3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:41 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e 1073741824" returned: 0 in 1.214s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:41 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e
Jun 29 04:52:41 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:41 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:41 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:41 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.862s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Deleted volume successfully.
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Flow 'volume_create_manager' (54b11138-eb49-4f9e-90c3-7dd9a8144d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba2311a-9f14-4035-bcf1-c24765c15cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-25d2ce04-0648-4e7d-a0ad-4494705c44e5 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "cinder-9d85d6f2-ef83-49bd-9f7a-53f5635bb714-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba2311a-9f14-4035-bcf1-c24765c15cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-371773213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6f67db-6616-4d48-ab9c-4cee637551af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f00483582446a183b4594332fb46fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:42Z,use_quota=True,user_id='8ddbb99277e74382906fd488c932e0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e421f9e0-59d4-4d4c-97be-5687d07c5081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e421f9e0-59d4-4d4c-97be-5687d07c5081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b13ab4-306b-411e-b1a4-731aeb5f2b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b13ab4-306b-411e-b1a4-731aeb5f2b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6f67db-6616-4d48-ab9c-4cee637551af', 'volume_name': 'volume-8e6f67db-6616-4d48-ab9c-4cee637551af', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3560262-2d83-4e4f-86f4-fee2d5683fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3560262-2d83-4e4f-86f4-fee2d5683fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd29a2-c101-4c00-bc28-c589f4ea43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume 8e6f67db-6616-4d48-ab9c-4cee637551af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6f67db-6616-4d48-ab9c-4cee637551af', 'volume_size': 1}
Jun 29 04:52:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:42 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" returned: 0 in 0.722s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1651653615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9c100c-534b-4366-92fe-dcbbb3345d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b953eced11fe4bf7ba15f6014eec831a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:41Z,use_quota=True,user_id='5c15233f261a44009e379aae26978763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Creating volume 7e9c100c-534b-4366-92fe-dcbbb3345d45 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:42 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3247b571-69b9-40a6-aec2-3abf5ed3f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:42 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 1073741824
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7cdad1-ea76-451a-b882-f5c39d19537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:42 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:42 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 0.863s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:42 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Volume volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e (61e5b50a-d7d5-4715-8da0-afd0cbc02f7e): created successfully
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7cdad1-ea76-451a-b882-f5c39d19537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (87584076-440a-436d-a730-56e71bda127b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:42 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637
Jun 29 04:52:42 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:42 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-90aafcfb-6a2a-434e-a117-47117ce5d0bb tempest-VolumesListTestJSON-1889736087 None] Created volume successfully.
Jun 29 04:52:43 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d242ccf2-b196-4723-87ca-5a5e55269637" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-d242ccf2-b196-4723-87ca-5a5e55269637" released by "delete_volume" :: held 1.646s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=169,cinder:UPDATE=170,cinder:DELETE=10,cinder:INSERT=42 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=153,cinder:INSERT=52,cinder:UPDATE=176,cinder:DELETE=8 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:52:43 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 1073741824" returned: 0 in 0.804s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['22050be6-c76b-4265-af03-167af52fb287', '4dcf30b4-aafc-4b05-b112-8e3e6bc94fdc', '7850ca84-d354-409d-b735-f1b77e51ca66', '42e88976-4a90-441a-85e6-365d960ca75f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:43 devstack sudo[103615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45
Jun 29 04:52:43 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:43 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:43 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:43 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.676s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:43 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (f0efba03-d3ea-465e-989c-b50c750d8bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cefe6e8-8b7d-44f1-ac90-e9edc150192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Deleted volume successfully.
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-371773213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6f67db-6616-4d48-ab9c-4cee637551af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f00483582446a183b4594332fb46fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:42Z,use_quota=True,user_id='8ddbb99277e74382906fd488c932e0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Creating volume 8e6f67db-6616-4d48-ab9c-4cee637551af {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:43 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cefe6e8-8b7d-44f1-ac90-e9edc150192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-218327478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b458ddb-c69d-41ed-9ea7-93d0c0302354,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:44Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack sudo[103623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af 1073741824
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f024486-a778-44d8-95e2-f801055008d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:44 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f024486-a778-44d8-95e2-f801055008d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d3ff12-842a-4199-9aa0-897fa25211a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d3ff12-842a-4199-9aa0-897fa25211a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b458ddb-c69d-41ed-9ea7-93d0c0302354', 'volume_name': 'volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67995f6d-9260-4fb3-b950-fdb3cd708577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67995f6d-9260-4fb3-b950-fdb3cd708577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2a31d9-f331-4b13-891d-8f7bd2c65376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Volume 2b458ddb-c69d-41ed-9ea7-93d0c0302354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354', 'volume_size': 1}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfba71aa-a127-486f-9080-ff23d5a9446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9c100c-534b-4366-92fe-dcbbb3345d45', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9d203-c240-450d-bbff-4d15b1524b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-27a21aa3-2095-4ba6-af89-53bac0e42222 tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-d242ccf2-b196-4723-87ca-5a5e55269637-delete_volume" released by "delete_volume" :: held 6.822s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-516995f4-9e66-4325-8edf-95291a08545f-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Volume volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 (7e9c100c-534b-4366-92fe-dcbbb3345d45): created successfully
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9d203-c240-450d-bbff-4d15b1524b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Flow 'volume_create_manager' (48f56a1e-1028-46d7-b8d3-ff95f5f98899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-516995f4-9e66-4325-8edf-95291a08545f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d10d21dc-20e4-48db-9fc7-6064a66bb608 tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Created volume successfully.
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a484eec-9aaf-4eda-8114-c00ea874c6b0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:44 devstack sudo[103625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f
Jun 29 04:52:44 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:44 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af 1073741824" returned: 0 in 0.873s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:44 devstack sudo[103633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af
Jun 29 04:52:44 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:44 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f" returned: 0 in 0.805s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:45 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f
Jun 29 04:52:45 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:45 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af" returned: 0 in 0.665s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-218327478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b458ddb-c69d-41ed-9ea7-93d0c0302354,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:44Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Creating volume 2b458ddb-c69d-41ed-9ea7-93d0c0302354 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:45 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:45 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 1073741824
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd29a2-c101-4c00-bc28-c589f4ea43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6f67db-6616-4d48-ab9c-4cee637551af', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:45 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a376f-6633-461b-a337-dcd6ccb2ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Volume volume-8e6f67db-6616-4d48-ab9c-4cee637551af (8e6f67db-6616-4d48-ab9c-4cee637551af): created successfully
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a376f-6633-461b-a337-dcd6ccb2ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Flow 'volume_create_manager' (54b11138-eb49-4f9e-90c3-7dd9a8144d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-123ecdd2-37cc-4f1d-8a6f-e9a9e1f08887 tempest-VolumeQuotasAdminTestJSON-1494496533 None] Created volume successfully.
Jun 29 04:52:45 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-516995f4-9e66-4325-8edf-95291a08545f" returned: 0 in 0.665s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-quobyte-516995f4-9e66-4325-8edf-95291a08545f" released by "delete_volume" :: held 1.522s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Created reservations ['f1b43cc1-d28b-4820-a4df-735b3b26f9df', 'e00ed44f-401b-4185-ad88-6d2a4167cba2', '45ee06f9-880b-48df-bbcd-99b122a7e978', '3855fca1-644b-4c07-9283-6267e8afeb1b'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:45 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:45 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Acquiring lock "cinder-7e9c100c-534b-4366-92fe-dcbbb3345d45-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "cinder-7e9c100c-534b-4366-92fe-dcbbb3345d45-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Acquiring lock "cinder-quobyte-7e9c100c-534b-4366-92fe-dcbbb3345d45" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "cinder-quobyte-7e9c100c-534b-4366-92fe-dcbbb3345d45" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e325ff4-5f2b-4b0b-9724-ba177192aa3e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:46 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45
Jun 29 04:52:46 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:46 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 1073741824" returned: 0 in 1.149s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5e6bcf7b-a119-49fb-92b7-7e0cdaaa23de tempest-VolumeQuotasAdminTestJSON-1139459678 None] Transfer volume completed successfully.
Jun 29 04:52:46 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.957s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Deleted volume successfully.
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:46 devstack sudo[103658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354
Jun 29 04:52:46 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2be88241-d4bd-4f6b-a7b5-66736509e0eb tempest-VolumesDeleteCascade-1831349382 None] Lock "cinder-516995f4-9e66-4325-8edf-95291a08545f-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:47 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45" returned: 0 in 0.992s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:47 devstack sudo[103663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45
Jun 29 04:52:47 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:47 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354" returned: 0 in 0.780s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2a31d9-f331-4b13-891d-8f7bd2c65376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18507e94-aca6-4e78-9e5b-6bbe1e28e48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Volume volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 (2b458ddb-c69d-41ed-9ea7-93d0c0302354): created successfully
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18507e94-aca6-4e78-9e5b-6bbe1e28e48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (f0efba03-d3ea-465e-989c-b50c750d8bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b85d1b7f-a6ed-475c-a137-1dba0cdf8ae3 tempest-VolumesListTestJSON-1889736087 None] Created volume successfully.
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Acquiring lock "cinder-8e6f67db-6616-4d48-ab9c-4cee637551af-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "cinder-8e6f67db-6616-4d48-ab9c-4cee637551af-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Acquiring lock "cinder-quobyte-8e6f67db-6616-4d48-ab9c-4cee637551af" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "cinder-quobyte-8e6f67db-6616-4d48-ab9c-4cee637551af" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0749ab4c-fdba-4402-9136-3e82768f3322]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:48 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af
Jun 29 04:52:48 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:48 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7e9c100c-534b-4366-92fe-dcbbb3345d45" returned: 0 in 0.911s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "cinder-quobyte-7e9c100c-534b-4366-92fe-dcbbb3345d45" released by "delete_volume" :: held 1.967s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Created reservations ['52ba6867-15b3-4f5e-9a62-e57e5b711653', 'f52175da-ad27-4c18-9f46-654fb6b6adf9', '01267ce5-e9e8-4be3-8ab3-f0c18970b367', '9b71a653-28d7-4429-aa7c-027e04c0762c'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:48 devstack sudo[103669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:48 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (aed5225a-de3e-44fa-ab29-e2258bc02283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25ad86-4051-448f-86a5-ab8a544eca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25ad86-4051-448f-86a5-ab8a544eca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-834135175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43354013-2ff7-46da-b353-25edee2be276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:49Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407b704-c393-4896-b4ab-33fa1d1a3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:48 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407b704-c393-4896-b4ab-33fa1d1a3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111afc2d-9e7a-4b88-8579-052a38616539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111afc2d-9e7a-4b88-8579-052a38616539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43354013-2ff7-46da-b353-25edee2be276', 'volume_name': 'volume-43354013-2ff7-46da-b353-25edee2be276', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b33f01-9f32-4a2a-aa9f-277ff0f95d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b33f01-9f32-4a2a-aa9f-277ff0f95d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df7c261-fe10-45a4-958b-01f7b4eb589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:48 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Volume 43354013-2ff7-46da-b353-25edee2be276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43354013-2ff7-46da-b353-25edee2be276', 'volume_size': 1}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-834135175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43354013-2ff7-46da-b353-25edee2be276,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4545e071dfa450db9cb89e4abb36727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:49Z,use_quota=True,user_id='4cfc9bbb3fbe44fe8e7ca3cd4b677e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Creating volume 43354013-2ff7-46da-b353-25edee2be276 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:48 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af" returned: 0 in 0.946s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:48 devstack sudo[103674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 1073741824
Jun 29 04:52:48 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:48 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af
Jun 29 04:52:48 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:49 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.840s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:49 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Deleted volume successfully.
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-814e8480-7756-4647-94a1-00a98c17bcbf tempest-VolumeQuotasNegativeTestJSON-1995324250 None] Lock "cinder-7e9c100c-534b-4366-92fe-dcbbb3345d45-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:49 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e6f67db-6616-4d48-ab9c-4cee637551af" returned: 0 in 0.760s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "cinder-quobyte-8e6f67db-6616-4d48-ab9c-4cee637551af" released by "delete_volume" :: held 1.753s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Created reservations ['1e958e9f-f7e5-4506-8f70-3564884b718e', '2c484ee9-119b-4bbc-8424-697b2c678bfe', '4138a96a-7c7f-42b5-a0a5-cc793401583d', '66afba1c-9a83-4341-a034-ff86d7432b96'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:49 devstack sudo[103684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:49 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:49 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 1073741824" returned: 0 in 1.049s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:50 devstack sudo[103686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276
Jun 29 04:52:50 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:50 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.873s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Deleted volume successfully.
Jun 29 04:52:50 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276" returned: 0 in 0.855s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-48fb90ae-05ef-4cda-a9f6-7b6072b5a4b5 tempest-VolumeQuotasAdminTestJSON-1653093891 None] Lock "cinder-8e6f67db-6616-4d48-ab9c-4cee637551af-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df7c261-fe10-45a4-958b-01f7b4eb589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43354013-2ff7-46da-b353-25edee2be276', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094db45-95b7-4b7a-b03e-2b23e67f4d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Volume volume-43354013-2ff7-46da-b353-25edee2be276 (43354013-2ff7-46da-b353-25edee2be276): created successfully
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094db45-95b7-4b7a-b03e-2b23e67f4d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Flow 'volume_create_manager' (aed5225a-de3e-44fa-ab29-e2258bc02283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2894ca47-69dd-45dd-b5cd-a28506f10cb3 tempest-VolumesListTestJSON-1889736087 None] Created volume successfully.
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Flow 'volume_create_manager' (72bedc80-3d26-4216-8e69-c7511063ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a12745-b80c-42d6-af95-dc3ddd5c244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a12745-b80c-42d6-af95-dc3ddd5c244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2032180397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339fbd59-17d0-44bf-a503-e3e36f29d92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a44914627f4ecf8ce7523418386ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:52Z,use_quota=True,user_id='6ea25596f9874e03951f1a75ad6e9128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb6aff3-f194-4684-8684-3262636ef753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb6aff3-f194-4684-8684-3262636ef753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9083448-e7be-49c7-9d5a-405f538b3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9083448-e7be-49c7-9d5a-405f538b3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339fbd59-17d0-44bf-a503-e3e36f29d92c', 'volume_name': 'volume-339fbd59-17d0-44bf-a503-e3e36f29d92c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5d86dd-a91f-44dc-a1df-d6584111b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5d86dd-a91f-44dc-a1df-d6584111b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a928e5-ca18-4757-8d2b-ecfa40f5a309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Volume 339fbd59-17d0-44bf-a503-e3e36f29d92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339fbd59-17d0-44bf-a503-e3e36f29d92c', 'volume_size': 1}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2032180397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339fbd59-17d0-44bf-a503-e3e36f29d92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a44914627f4ecf8ce7523418386ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:52Z,use_quota=True,user_id='6ea25596f9874e03951f1a75ad6e9128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Creating volume 339fbd59-17d0-44bf-a503-e3e36f29d92c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:52 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:52 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c 1073741824
Jun 29 04:52:52 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:53 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c 1073741824" returned: 0 in 1.057s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:53 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c
Jun 29 04:52:53 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:54 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c" returned: 0 in 0.754s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a928e5-ca18-4757-8d2b-ecfa40f5a309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339fbd59-17d0-44bf-a503-e3e36f29d92c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7586c738-7cab-40f3-b440-1d9c94236edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Volume volume-339fbd59-17d0-44bf-a503-e3e36f29d92c (339fbd59-17d0-44bf-a503-e3e36f29d92c): created successfully
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7586c738-7cab-40f3-b440-1d9c94236edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Flow 'volume_create_manager' (72bedc80-3d26-4216-8e69-c7511063ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:54 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e440baaf-c067-4c4b-8065-d8ab43e01d30 tempest-VolumesTransfersTest-700350582 None] Created volume successfully.
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-43354013-2ff7-46da-b353-25edee2be276-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-43354013-2ff7-46da-b353-25edee2be276-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-quobyte-43354013-2ff7-46da-b353-25edee2be276" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-43354013-2ff7-46da-b353-25edee2be276" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdca21f0-18a4-44e5-965d-80103a972bd2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:55 devstack sudo[103700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276
Jun 29 04:52:55 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:56 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276" returned: 0 in 1.103s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:56 devstack sudo[103705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276
Jun 29 04:52:56 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d62b4160-79a9-426f-a317-41d2312686da tempest-VolumesTransfersTest-22850679 None] Transfer volume completed successfully.
Jun 29 04:52:57 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-43354013-2ff7-46da-b353-25edee2be276" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-43354013-2ff7-46da-b353-25edee2be276" released by "delete_volume" :: held 1.937s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Created reservations ['11c0c89d-912b-4962-96ff-ffde980fcaeb', '53c6ae0b-8eb1-44ad-b3b8-a42dd56fe025', '7116458f-0a90-4482-bc1f-ddb6e8e5227b', 'bed0846d-9cdd-46ab-b034-0b7fcb26ac3e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Flow 'volume_create_manager' (9179d9c9-8647-4ad6-9f0d-bc6049860e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5a0a3-0325-4828-a3a0-dd691973af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5a0a3-0325-4828-a3a0-dd691973af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-913773687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadfe142-ab66-41b5-af4e-a84a36d4331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2f1593211449c98e7ad16e384c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:57Z,use_quota=True,user_id='45fab815330d4371b9663bc14012d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905d4700-b724-4309-b94f-3dfd0c2dea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905d4700-b724-4309-b94f-3dfd0c2dea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fabdc6-be80-4256-b561-7afd055df4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fabdc6-be80-4256-b561-7afd055df4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadfe142-ab66-41b5-af4e-a84a36d4331b', 'volume_name': 'volume-eadfe142-ab66-41b5-af4e-a84a36d4331b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517763c0-e7cc-412f-b89d-127b733e783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517763c0-e7cc-412f-b89d-127b733e783e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa8824d-e510-4b83-a506-3233d828db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:57 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Volume eadfe142-ab66-41b5-af4e-a84a36d4331b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadfe142-ab66-41b5-af4e-a84a36d4331b', 'volume_size': 1}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-913773687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadfe142-ab66-41b5-af4e-a84a36d4331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2f1593211449c98e7ad16e384c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:52:57Z,use_quota=True,user_id='45fab815330d4371b9663bc14012d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Creating volume eadfe142-ab66-41b5-af4e-a84a36d4331b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:52:57 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:57 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b 1073741824
Jun 29 04:52:57 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:57 devstack sudo[103709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:57 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-2b458ddb-c69d-41ed-9ea7-93d0c0302354-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-2b458ddb-c69d-41ed-9ea7-93d0c0302354-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-quobyte-2b458ddb-c69d-41ed-9ea7-93d0c0302354" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-2b458ddb-c69d-41ed-9ea7-93d0c0302354" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c375d-8a21-41a1-9d55-c4a3db502a02]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:57 devstack sudo[103712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354
Jun 29 04:52:57 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "cinder-339fbd59-17d0-44bf-a503-e3e36f29d92c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-339fbd59-17d0-44bf-a503-e3e36f29d92c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "cinder-quobyte-339fbd59-17d0-44bf-a503-e3e36f29d92c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-quobyte-339fbd59-17d0-44bf-a503-e3e36f29d92c" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9d90f-e1de-498e-93e3-1543df5511a7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:58 devstack sudo[103716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c
Jun 29 04:52:58 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:58 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.989s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:52:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Deleted volume successfully.
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-7d1cb26d-3878-43f6-acb0-7cc41638500f tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-43354013-2ff7-46da-b353-25edee2be276-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:58 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b 1073741824" returned: 0 in 1.244s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:58 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b
Jun 29 04:52:58 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:59 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354" returned: 0 in 1.231s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:59 devstack sudo[103731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354
Jun 29 04:52:59 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:59 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c" returned: 0 in 0.893s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:59 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c
Jun 29 04:52:59 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:52:59 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b" returned: 0 in 0.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa8824d-e510-4b83-a506-3233d828db31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadfe142-ab66-41b5-af4e-a84a36d4331b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0f2ef5-3dc5-48a1-9fce-6780aa0fd019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:52:59 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Volume volume-eadfe142-ab66-41b5-af4e-a84a36d4331b (eadfe142-ab66-41b5-af4e-a84a36d4331b): created successfully
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0f2ef5-3dc5-48a1-9fce-6780aa0fd019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Flow 'volume_create_manager' (9179d9c9-8647-4ad6-9f0d-bc6049860e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:52:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ba177356-9665-4bc0-9dbc-debdce7c7af8 tempest-VolumesServicesTestJSON-613965472 None] Created volume successfully.
Jun 29 04:52:59 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2b458ddb-c69d-41ed-9ea7-93d0c0302354" returned: 0 in 0.755s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-2b458ddb-c69d-41ed-9ea7-93d0c0302354" released by "delete_volume" :: held 2.079s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Created reservations ['c58e847e-8636-429d-92ce-9662952ac580', 'a9b595fa-4508-4208-992e-d52d14ae4eb2', 'a554cf25-8428-40fe-971c-97adeb389c42', 'ddca8776-2d18-4289-a118-15660a53ad04'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:52:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:52:59 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:52:59 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:00 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339fbd59-17d0-44bf-a503-e3e36f29d92c" returned: 0 in 0.828s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-quobyte-339fbd59-17d0-44bf-a503-e3e36f29d92c" released by "delete_volume" :: held 1.786s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Created reservations ['f1f15d77-6296-4a32-b2aa-fc863e323d17', 'fb2b0472-b76c-4f57-a2e2-bedfa02640a5', 'eeb91636-f400-467c-80d5-8b805d5cbb3c', 'ca47c2d8-1be0-40aa-bd21-cc49cbb2340d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:00 devstack sudo[103742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:00 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:00 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.695s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:00 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Deleted volume successfully.
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-00ce86a4-2cbe-4d82-86b4-fd10da4711b1 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-2b458ddb-c69d-41ed-9ea7-93d0c0302354-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Acquiring lock "cinder-eadfe142-ab66-41b5-af4e-a84a36d4331b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "cinder-eadfe142-ab66-41b5-af4e-a84a36d4331b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Acquiring lock "cinder-quobyte-eadfe142-ab66-41b5-af4e-a84a36d4331b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "cinder-quobyte-eadfe142-ab66-41b5-af4e-a84a36d4331b" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ff41a-2470-48c3-ac05-768b0c0e9671]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:01 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:01 devstack sudo[103746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b
Jun 29 04:53:01 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.984s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Deleted volume successfully.
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f5bed1c9-25e9-4711-b7f0-97cbef4c3486 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-339fbd59-17d0-44bf-a503-e3e36f29d92c-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "cinder-quobyte-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[636338fe-fbdd-47b2-ae7a-3f54808ef31c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Flow 'volume_create_manager' (fdcccba5-991e-4ba1-bd63-20018eae3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d6c8b0-5b26-4e54-9a4d-5dffee3caa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d6c8b0-5b26-4e54-9a4d-5dffee3caa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-424557125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d1ac08-4721-414d-bf25-882365bd7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a44914627f4ecf8ce7523418386ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:01Z,use_quota=True,user_id='6ea25596f9874e03951f1a75ad6e9128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e70d3b4-9f04-4b2c-bd4e-ee15f1fafcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:01 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e
Jun 29 04:53:01 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e70d3b4-9f04-4b2c-bd4e-ee15f1fafcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81450999-e335-4a39-a1e1-2214e5e24115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81450999-e335-4a39-a1e1-2214e5e24115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d1ac08-4721-414d-bf25-882365bd7884', 'volume_name': 'volume-92d1ac08-4721-414d-bf25-882365bd7884', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1736d1-580c-4ad1-84bd-acaf9898651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1736d1-580c-4ad1-84bd-acaf9898651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5617f281-cd2f-469a-a54d-49d31fcd9cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Volume 92d1ac08-4721-414d-bf25-882365bd7884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d1ac08-4721-414d-bf25-882365bd7884', 'volume_size': 1}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-424557125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d1ac08-4721-414d-bf25-882365bd7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a44914627f4ecf8ce7523418386ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:01Z,use_quota=True,user_id='6ea25596f9874e03951f1a75ad6e9128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Creating volume 92d1ac08-4721-414d-bf25-882365bd7884 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:01 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:01 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 1073741824
Jun 29 04:53:01 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:01 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b" returned: 0 in 1.036s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:02 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b
Jun 29 04:53:02 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:02 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" returned: 0 in 1.053s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:02 devstack sudo[103764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e
Jun 29 04:53:02 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:02 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 1073741824" returned: 0 in 1.204s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:02 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884
Jun 29 04:53:02 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:02 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eadfe142-ab66-41b5-af4e-a84a36d4331b" returned: 0 in 0.926s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "cinder-quobyte-eadfe142-ab66-41b5-af4e-a84a36d4331b" released by "delete_volume" :: held 2.022s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:02 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Created reservations ['7eee5c68-96ee-495d-9ee2-74bc418a1360', '422eaea5-23ee-403d-9c66-f87cbac9ef86', 'ec765b7d-9dc3-446b-9cc3-0061c443bd3b', '7bc396dd-b368-4cdc-acbd-8bdcf1693c62'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:03 devstack sudo[103770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:03 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:03 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" returned: 0 in 1.110s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-quobyte-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e" released by "delete_volume" :: held 2.237s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:03 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:03 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:03 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Created reservations ['6ce979ca-ac7c-4609-a036-e74b40e4eb0e', '0a14e1a6-77dd-4beb-8726-5a78851e9b73', '981474a6-3a39-4932-8572-a78de1ed8329', '3c499b4e-8710-4336-ac8a-ac4ce358b7d1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884" returned: 0 in 0.881s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5617f281-cd2f-469a-a54d-49d31fcd9cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d1ac08-4721-414d-bf25-882365bd7884', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e71b7c2-7564-43c5-8507-52581786dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:03 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Volume volume-92d1ac08-4721-414d-bf25-882365bd7884 (92d1ac08-4721-414d-bf25-882365bd7884): created successfully
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e71b7c2-7564-43c5-8507-52581786dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Flow 'volume_create_manager' (fdcccba5-991e-4ba1-bd63-20018eae3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:03 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1245e19-e4f6-4901-9205-f9c8025b5c8a tempest-VolumesTransfersTest-700350582 None] Created volume successfully.
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:03 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:03 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.941s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:04 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Deleted volume successfully.
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2368b22-ead7-4b09-b12a-9320c11cc5cc tempest-VolumesServicesTestJSON-613965472 None] Lock "cinder-eadfe142-ab66-41b5-af4e-a84a36d4331b-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:04 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.921s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:53:04 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Deleted volume successfully.
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f91cb5-2983-47b3-93fc-d8436667d931 tempest-VolumesListTestJSON-1889736087 None] Lock "cinder-61e5b50a-d7d5-4715-8da0-afd0cbc02f7e-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "cinder-92d1ac08-4721-414d-bf25-882365bd7884-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-92d1ac08-4721-414d-bf25-882365bd7884-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "cinder-quobyte-92d1ac08-4721-414d-bf25-882365bd7884" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-quobyte-92d1ac08-4721-414d-bf25-882365bd7884" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9fc3da-e1b8-4ff9-8c68-a219e5e0bec3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:05 devstack sudo[103782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884
Jun 29 04:53:05 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:06 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884" returned: 0 in 1.043s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:06 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884
Jun 29 04:53:06 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:06 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-92d1ac08-4721-414d-bf25-882365bd7884" returned: 0 in 0.770s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-quobyte-92d1ac08-4721-414d-bf25-882365bd7884" released by "delete_volume" :: held 1.884s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Created reservations ['3cb1f350-b46d-4c6d-b8b5-afabee8f1e6f', 'aca71111-a5b5-4bf9-971b-05e4d17d523c', '78806679-bbfa-42c8-9c41-6ddf9be3cde1', 'e653226e-d18b-4b0d-9b31-fb3e7ec40ca2'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:07 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:07 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:08 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.844s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:08 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Deleted volume successfully.
Jun 29 04:53:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b6ceea95-c949-4c94-bd98-8bb3525d51e1 tempest-VolumesTransfersTest-1216140451 None] Lock "cinder-92d1ac08-4721-414d-bf25-882365bd7884-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Flow 'volume_create_manager' (00af7d26-0dcb-4f13-8485-0f99a5462b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4826f03-ac0f-44c6-bf87-daa6869fcc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4826f03-ac0f-44c6-bf87-daa6869fcc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1793535963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28cd730-7caf-45ec-b508-f011150c85d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76299cf0641e4bd3a82dc34590c0e41b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:12Z,use_quota=True,user_id='de9f942f99b9479ca1036224fa3a4316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceedba99-2104-49d7-9b0d-8ffba494cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceedba99-2104-49d7-9b0d-8ffba494cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c6262a-4a9a-4033-8848-82da9bd140be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Flow 'volume_create_manager' (162b4d1b-8d33-428b-8b4f-be9de5064f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a60171-7cf2-4783-8101-eef4fffda6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a60171-7cf2-4783-8101-eef4fffda6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-636770538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad72ab86-18d1-468e-89c8-76128485dbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be720f0799744adb80dd0b2a67df328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:12Z,use_quota=True,user_id='61fabddea9364c3b882fb145942da725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82394705-173e-488e-a9d2-1a6b0ed06544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82394705-173e-488e-a9d2-1a6b0ed06544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84283c36-6ce1-43bf-b7d2-947428662001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84283c36-6ce1-43bf-b7d2-947428662001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad72ab86-18d1-468e-89c8-76128485dbb3', 'volume_name': 'volume-ad72ab86-18d1-468e-89c8-76128485dbb3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69a4deb-8d56-41c6-b7be-d4a2116da117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69a4deb-8d56-41c6-b7be-d4a2116da117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a64d46-a750-4a6d-97a5-27e68f94b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Volume ad72ab86-18d1-468e-89c8-76128485dbb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad72ab86-18d1-468e-89c8-76128485dbb3', 'volume_size': 1}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-636770538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad72ab86-18d1-468e-89c8-76128485dbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be720f0799744adb80dd0b2a67df328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:12Z,use_quota=True,user_id='61fabddea9364c3b882fb145942da725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Creating volume ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:12 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 1073741824
Jun 29 04:53:12 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c6262a-4a9a-4033-8848-82da9bd140be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f28cd730-7caf-45ec-b508-f011150c85d6', 'volume_name': 'volume-f28cd730-7caf-45ec-b508-f011150c85d6', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d3a270>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df1fc84-bb4d-4fa8-bd47-e97ff9b124f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df1fc84-bb4d-4fa8-bd47-e97ff9b124f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e14c01d-cdf8-4b04-8db9-c5e1a8d5c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Volume f28cd730-7caf-45ec-b508-f011150c85d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f28cd730-7caf-45ec-b508-f011150c85d6', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d3a270>}
Jun 29 04:53:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Trying to clone f28cd730-7caf-45ec-b508-f011150c85d6 from image 715ee343-4947-44c8-82ac-b52ccc04493d at location (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 04:53:13 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 04:53:13 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Image download 20.69 MB at 20.69 MB/s
Jun 29 04:53:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd0035b-c28e-455d-b39d-d6541cf71412]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:13 devstack sudo[103835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD
Jun 29 04:53:13 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:13 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 1073741824" returned: 0 in 1.115s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:13 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3
Jun 29 04:53:13 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:14 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD" returned: 0 in 0.987s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d is fetched for user de9f942f99b9479ca1036224fa3a4316. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 04:53:14 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3" returned: 0 in 0.862s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5834e668-54a8-4846-bd58-de099d6bf385]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a64d46-a750-4a6d-97a5-27e68f94b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad72ab86-18d1-468e-89c8-76128485dbb3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8839943a-e601-4d12-a023-83b0a09d1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Volume volume-ad72ab86-18d1-468e-89c8-76128485dbb3 (ad72ab86-18d1-468e-89c8-76128485dbb3): created successfully
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8839943a-e601-4d12-a023-83b0a09d1704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Flow 'volume_create_manager' (162b4d1b-8d33-428b-8b4f-be9de5064f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-594a00d0-902e-4377-a224-8d756641f3de tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Created volume successfully.
Jun 29 04:53:14 devstack sudo[103843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD
Jun 29 04:53:14 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Flow 'volume_create_manager' (86d3a9ec-ac76-40e3-98db-1eb79a714ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f990eaa-bb06-4d14-811e-5343da62c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f990eaa-bb06-4d14-811e-5343da62c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1711836767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e17f678-3b9f-4eb2-b754-8b6ca862ef31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec84b3f1aa04dd281e8a63e3be6c0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:15Z,use_quota=True,user_id='0e22169053344a1995124ff4c44ae797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74c3857-d0a3-4ce0-aa93-b1c5da25be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74c3857-d0a3-4ce0-aa93-b1c5da25be8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe92c64-a962-44db-b7d8-2e94d89c1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe92c64-a962-44db-b7d8-2e94d89c1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'volume_name': 'volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f46a26-8e2f-4462-b295-97379a07788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f46a26-8e2f-4462-b295-97379a07788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e8d12e-e68e-4a9b-a92b-9df302a43cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Volume 4e17f678-3b9f-4eb2-b754-8b6ca862ef31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'volume_size': 1}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1711836767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e17f678-3b9f-4eb2-b754-8b6ca862ef31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec84b3f1aa04dd281e8a63e3be6c0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:15Z,use_quota=True,user_id='0e22169053344a1995124ff4c44ae797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Creating volume 4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:14 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:14 devstack sudo[103845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 1073741824
Jun 29 04:53:14 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:15 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD" returned: 0 in 1.041s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:16 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 1073741824" returned: 0 in 1.148s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:16 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:16 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:16 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 0.658s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1793535963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28cd730-7caf-45ec-b508-f011150c85d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76299cf0641e4bd3a82dc34590c0e41b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:12Z,use_quota=True,user_id='de9f942f99b9479ca1036224fa3a4316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Creating volume f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:16 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e8d12e-e68e-4a9b-a92b-9df302a43cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:16 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1073741824
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44b097e-5224-4f6b-a58b-782fc3e796c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:16 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Volume volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 (4e17f678-3b9f-4eb2-b754-8b6ca862ef31): created successfully
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44b097e-5224-4f6b-a58b-782fc3e796c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Flow 'volume_create_manager' (86d3a9ec-ac76-40e3-98db-1eb79a714ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5e735fd5-ee71-4bb6-af10-0b65906339a1 tempest-VolumesCloneTest-162653605 None] Created volume successfully.
Jun 29 04:53:17 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1073741824" returned: 0 in 0.950s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:17 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:17 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Flow 'volume_create_manager' (a008009c-02be-4f2b-a069-eecc4e3322b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:18 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e96a0a4-925d-4378-a0f7-2cceb196c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 0 in 0.835s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.900s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e96a0a4-925d-4378-a0f7-2cceb196c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1932965069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3083171-7542-4468-8682-faa00d9d5132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec84b3f1aa04dd281e8a63e3be6c0a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=4e17f678-3b9f-4eb2-b754-8b6ca862ef31,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:19Z,use_quota=True,user_id='0e22169053344a1995124ff4c44ae797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2e7bbd-9610-459d-bbff-ffdb45668385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2e7bbd-9610-459d-bbff-ffdb45668385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34273e92-a9d5-42ff-9596-ec40cf4ef8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Creating offline snapshot 26a4b6b6-804c-4613-9de1-d71ac4fe8e3a of volume ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34273e92-a9d5-42ff-9596-ec40cf4ef8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f3083171-7542-4468-8682-faa00d9d5132', 'volume_name': 'volume-f3083171-7542-4468-8682-faa00d9d5132', 'volume_size': 2, 'source_volid': '4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'source_volstatus': 'available'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a827bb-3446-44e5-9dae-4c02330c90c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a827bb-3446-44e5-9dae-4c02330c90c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f132df-d6d2-413f-a0f9-95cd1771bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:18 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Volume f3083171-7542-4468-8682-faa00d9d5132: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f3083171-7542-4468-8682-faa00d9d5132', 'volume_size': 2, 'source_volid': '4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'source_volstatus': 'available'}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[167df209-5758-4818-a947-83865fe5e42e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Attempting download of 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume f28cd730-7caf-45ec-b508-f011150c85d6. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa198338-c4d7-43c6-a9c9-ac4d358218fc]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:18 devstack sudo[103867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3
Jun 29 04:53:18 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:18 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl
Jun 29 04:53:18 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:19 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl" returned: 0 in 0.784s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:19 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3" returned: 0 in 0.908s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:19 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a 1G
Jun 29 04:53:19 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:19 devstack sudo[103876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl
Jun 29 04:53:19 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:20 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl" returned: 1 in 0.817s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_gh0lkgzl' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf15ad-340e-4e7f-a844-ed04abccde52]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:20 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a 1G" returned: 0 in 0.891s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72ab86-18d1-468e-89c8-76128485dbb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:20 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD
Jun 29 04:53:20 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:20 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72ab86-18d1-468e-89c8-76128485dbb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a
Jun 29 04:53:20 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD" returned: 0 in 0.811s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:21 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] 715ee343-4947-44c8-82ac-b52ccc04493d was qcow2, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 04:53:21 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:21 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:21 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:21 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72ab86-18d1-468e-89c8-76128485dbb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" returned: 0 in 0.807s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:21 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a is being set with open permissions: ugo+rw
Jun 29 04:53:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:21 devstack sudo[103898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a
Jun 29 04:53:21 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:22 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" returned: 0 in 0.720s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:22 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info
Jun 29 04:53:22 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:22 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info" returned: 0 in 0.697s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:22 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info is being set with open permissions: ugo+rw
Jun 29 04:53:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:22 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info
Jun 29 04:53:22 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:23 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 0 in 2.267s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_euzulg07devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:53:23 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Converted 112.00 MB image at 49.37 MB/s
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:23 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.info" returned: 0 in 0.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:23 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1G
Jun 29 04:53:23 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.896s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.803s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:23 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Cloning volume 4e17f678-3b9f-4eb2-b754-8b6ca862ef31 to volume f3083171-7542-4468-8682-faa00d9d5132
Jun 29 04:53:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e5e837bb-cca6-4d6b-b499-877c4ffb165e tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Create snapshot completed successfully
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Creating offline snapshot f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 of volume 4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28aa655-15dd-4f51-8345-8831ca4cc506]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:23 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:23 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:24 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 1G" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a3c627-58ea-43c6-b88a-bc6943d161a5]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:24 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:24 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:24 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 0.981s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:24 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 1G
Jun 29 04:53:24 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "cinder-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "cinder-quobyte-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Deleting offline snapshot 26a4b6b6-804c-4613-9de1-d71ac4fe8e3a of volume ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] snapshot_file for this snap is: volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e13e0-6e03-4b89-b1b6-7ac978807efd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:24 devstack sudo[103928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a
Jun 29 04:53:24 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:25 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 0 in 1.068s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:25 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 1G" returned: 0 in 1.006s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:25 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:25 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:25 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:25 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:25 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" returned: 0 in 0.981s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad72ab86-18d1-468e-89c8-76128485dbb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb8dda9-00f9-411a-9b30-fa3366b6d513]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:25 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3
Jun 29 04:53:25 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:26 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 1 in 0.913s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Downloaded image 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume f28cd730-7caf-45ec-b508-f011150c85d6 successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d for user de9f942f99b9479ca1036224fa3a4316 is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Marking volume f28cd730-7caf-45ec-b508-f011150c85d6 as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Copying metadata from image 715ee343-4947-44c8-82ac-b52ccc04493d to f28cd730-7caf-45ec-b508-f011150c85d6. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Creating volume glance metadata for volume f28cd730-7caf-45ec-b508-f011150c85d6 backed by image 715ee343-4947-44c8-82ac-b52ccc04493d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 04:53:26 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 0.819s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:26 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 is being set with open permissions: ugo+rw
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:26 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:26 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e14c01d-cdf8-4b04-8db9-c5e1a8d5c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28cd730-7caf-45ec-b508-f011150c85d6', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d3a270>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9381d7-533f-4774-9966-ee22e6f938c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Volume volume-f28cd730-7caf-45ec-b508-f011150c85d6 (f28cd730-7caf-45ec-b508-f011150c85d6): created successfully
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9381d7-533f-4774-9966-ee22e6f938c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Flow 'volume_create_manager' (00af7d26-0dcb-4f13-8485-0f99a5462b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-00b1afff-584f-4a5d-9365-d39faa965220 tempest-VolumesImageMetadata-1476271984 None] Created volume successfully.
Jun 29 04:53:26 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3" returned: 0 in 1.006s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:26 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a
Jun 29 04:53:26 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:27 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:27 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info
Jun 29 04:53:27 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:27 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" returned: 0 in 0.903s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:27 devstack sudo[103967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a
Jun 29 04:53:27 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Acquiring lock "cinder-f28cd730-7caf-45ec-b508-f011150c85d6-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "cinder-f28cd730-7caf-45ec-b508-f011150c85d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Acquiring lock "cinder-quobyte-f28cd730-7caf-45ec-b508-f011150c85d6" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "cinder-quobyte-f28cd730-7caf-45ec-b508-f011150c85d6" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db20db-3c9d-4a12-8bad-4cf3199a4330]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info" returned: 0 in 1.082s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:28 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info is being set with open permissions: ugo+rw
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:28 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:28 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info
Jun 29 04:53:28 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:28 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:28 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:28 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3.26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" returned: 0 in 1.033s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a" released by "_delete_snapshot" :: held 4.086s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" released by "delete_snapshot" :: held 4.125s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Created reservations ['ca0c06ed-38ba-4703-b09f-3552f53033fc', 'ef58fa37-d0c3-48a0-9fc6-47ed7cad5d79', '4133df5c-07ef-4ad2-bff6-4127a38e5485', '2d1b1e41-6661-45af-84e3-d9b6bd8036dc'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Delete snapshot completed successfully.
Jun 29 04:53:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c7310ac-011c-4a22-852b-141895ca2dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-26a4b6b6-804c-4613-9de1-d71ac4fe8e3a-delete_snapshot" released by "delete_snapshot" :: held 4.321s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:29 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:29 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 0 in 1.138s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.info" returned: 0 in 1.053s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] snapshot: f89c4dfe-aa00-4ba1-a1d3-1a76a008f889, volume: f3083171-7542-4468-8682-faa00d9d5132,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbf4bd4-2dfe-4168-abe0-38984cf927d4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:29 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:29 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:29 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:29 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "cinder-ad72ab86-18d1-468e-89c8-76128485dbb3-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-ad72ab86-18d1-468e-89c8-76128485dbb3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f83b6-862c-42b6-bc7b-c79c548c52d9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:30 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 1 in 1.021s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:30 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6
Jun 29 04:53:30 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:30 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3
Jun 29 04:53:30 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:30 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 1.044s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eafb12-ef34-4b38-a2f7-5118d45e8425]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:30 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:30 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:31 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f28cd730-7caf-45ec-b508-f011150c85d6" returned: 0 in 0.793s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "cinder-quobyte-f28cd730-7caf-45ec-b508-f011150c85d6" released by "delete_volume" :: held 3.113s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Created reservations ['d1cb39ee-0e18-4f36-90bc-e193863c6256', '17ba36c5-3011-45e6-86a3-27b8207c1fef', '75386924-2e80-4741-bc5c-dc0842089c4a', 'ea07b2eb-48c0-4923-8e17-4ff9181851bf'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:31 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3" returned: 0 in 1.155s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:31 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3
Jun 29 04:53:31 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:31 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:31 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:31 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 1.420s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:53:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:31 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132
Jun 29 04:53:31 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:32 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ad72ab86-18d1-468e-89c8-76128485dbb3" returned: 0 in 1.074s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-quobyte-ad72ab86-18d1-468e-89c8-76128485dbb3" released by "delete_volume" :: held 2.308s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:32 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.098s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:32 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Deleted volume successfully.
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Created reservations ['c422f46d-0522-494d-9df1-09df0d91e0e5', '5668b360-a1de-495e-bff7-8cc270831967', '7af44535-1aa1-4fcb-af60-a758650ade85', '610f2a9a-1e56-4627-abc6-124333370f3a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b14d1866-c83e-473e-b2fe-70ee6adeb0f2 tempest-VolumesImageMetadata-1476271984 None] Lock "cinder-f28cd730-7caf-45ec-b508-f011150c85d6-delete_volume" released by "delete_volume" :: held 4.639s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:32 devstack sudo[104010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:32 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:34 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.685s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:34 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Deleted volume successfully.
Jun 29 04:53:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6e678fcd-7a62-4d27-af72-53aa81684e20 tempest-VolumeSnapshotQuotasNegativeTestJSON-1025232162 None] Lock "cinder-ad72ab86-18d1-468e-89c8-76128485dbb3-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:39 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132" returned: 0 in 7.235s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54d624d-797f-4882-ac42-9b752cfba72e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:39 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:39 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:40 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 1.074s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:53:40 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Converted 1024.00 MB image at 141.51 MB/s
Jun 29 04:53:40 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 is being set with open permissions: ugo+rw
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:40 devstack sudo[104031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132
Jun 29 04:53:40 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:40 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132" returned: 0 in 0.706s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" released by "_copy_volume_from_snapshot" :: held 11.608s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-quobyte-f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Deleting offline snapshot f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 of volume 4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:53:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] snapshot_file for this snap is: volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:53:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e58f4b8-8803-46c0-83f9-b384982358c4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:41 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:41 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:42 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 0.982s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:53:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bc5a9-b9ff-4c69-b82f-41e13ec3d7ab]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:42 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:42 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:43 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 0.978s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:43 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:43 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:INSERT=45,cinder:SELECT=100,cinder:UPDATE=133,cinder:DELETE=13 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=10 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (658e6808-fa2b-475d-9b13-742723e46ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd62ba-327f-40af-a801-4343dd31b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd62ba-327f-40af-a801-4343dd31b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1955093981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dabb62e-3ba6-45c1-b66f-626775b80c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5490a739-63e2-4c74-b277-2b2024678e6e),volume_type_id=5490a739-63e2-4c74-b277-2b2024678e6e)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8150b-497e-4bee-8f26-b32e88f33db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8150b-497e-4bee-8f26-b32e88f33db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36f7f4a-e7d8-4d26-914b-b0661ab68b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36f7f4a-e7d8-4d26-914b-b0661ab68b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dabb62e-3ba6-45c1-b66f-626775b80c47', 'volume_name': 'volume-1dabb62e-3ba6-45c1-b66f-626775b80c47', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81b9163-61d5-4958-8fe5-c4e241a13e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81b9163-61d5-4958-8fe5-c4e241a13e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b447f673-711f-471c-b9da-9aaad37b56ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Volume 1dabb62e-3ba6-45c1-b66f-626775b80c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dabb62e-3ba6-45c1-b66f-626775b80c47', 'volume_size': 1}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:44 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 1.087s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:44 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889
Jun 29 04:53:44 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (57312cbf-cb15-4caf-aa8b-377412fa33bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c664f8-ea5e-4ce2-ae94-1b859d708bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c664f8-ea5e-4ce2-ae94-1b859d708bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1965811444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e73756-a2ec-40f7-b1df-251ee40a5d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce20989-bcd7-4ce4-8f78-416e360d8d6a),volume_type_id=5ce20989-bcd7-4ce4-8f78-416e360d8d6a)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380edf5a-31b0-4257-a40b-67fdedf71c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380edf5a-31b0-4257-a40b-67fdedf71c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc45fba-c215-4108-9663-b18c301cb2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc45fba-c215-4108-9663-b18c301cb2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e73756-a2ec-40f7-b1df-251ee40a5d75', 'volume_name': 'volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2420c9cf-7d73-4191-a67c-41bf57630760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2420c9cf-7d73-4191-a67c-41bf57630760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a67773-919f-4c50-be91-000f0511c213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Volume d9e73756-a2ec-40f7-b1df-251ee40a5d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75', 'volume_size': 1}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Flow 'volume_create_manager' (5a63bddb-297d-47cd-b5fa-aa202886a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ddc8fc-cbd6-4d0d-b91a-b8ed93911532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ddc8fc-cbd6-4d0d-b91a-b8ed93911532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1676262933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b51186-ff21-4873-8f61-9b5b0c23ade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f59bcd193a4c92b78add67dcf340f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='c2e637d978aa49fe91e45cf0a05ff03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d2fb97-07d3-4a43-bb8e-999ac730e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d2fb97-07d3-4a43-bb8e-999ac730e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f4a3ac-3aec-4efb-882d-01943c359ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f4a3ac-3aec-4efb-882d-01943c359ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b51186-ff21-4873-8f61-9b5b0c23ade2', 'volume_name': 'volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1d0bc2-ef0e-47db-84a6-d68da3ade6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1d0bc2-ef0e-47db-84a6-d68da3ade6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41dd27a-3a66-4e7d-82e3-ca91321509c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Volume f6b51186-ff21-4873-8f61-9b5b0c23ade2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2', 'volume_size': 1}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:44 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31.f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" returned: 0 in 0.760s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f89c4dfe-aa00-4ba1-a1d3-1a76a008f889" released by "_delete_snapshot" :: held 3.936s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.475s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1955093981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dabb62e-3ba6-45c1-b66f-626775b80c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5490a739-63e2-4c74-b277-2b2024678e6e),volume_type_id=5490a739-63e2-4c74-b277-2b2024678e6e)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Creating volume 1dabb62e-3ba6-45c1-b66f-626775b80c47 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:45 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f132df-d6d2-413f-a0f9-95cd1771bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3083171-7542-4468-8682-faa00d9d5132', 'volume_size': 2, 'source_volid': '4e17f678-3b9f-4eb2-b754-8b6ca862ef31', 'source_volstatus': 'available'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b16051-1df2-47e5-87c1-e50e649bafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 1073741824
Jun 29 04:53:45 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Volume volume-f3083171-7542-4468-8682-faa00d9d5132 (f3083171-7542-4468-8682-faa00d9d5132): created successfully
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b16051-1df2-47e5-87c1-e50e649bafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Flow 'volume_create_manager' (a008009c-02be-4f2b-a069-eecc4e3322b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9f9617f0-fb41-40ef-b065-409aa0cfd239 tempest-VolumesCloneTest-162653605 None] Created volume successfully.
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (dcbf6ea9-3664-49e9-9b00-7a99b1bf336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb67ea99-0802-41c7-8e3c-289377f0187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb67ea99-0802-41c7-8e3c-289377f0187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-573041424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab19944-240b-4bb5-bc77-b3b982ef39d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:45Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad72602-558b-4180-be3b-b554816fc9a5),volume_type_id=aad72602-558b-4180-be3b-b554816fc9a5)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2274582c-c509-41d7-ae1a-d05018d89928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2274582c-c509-41d7-ae1a-d05018d89928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b686c1fb-8407-40c5-9bde-727733eb1c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Flow 'volume_create_manager' (616932c7-c46d-48b0-ae80-39dcd119840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5806438f-8ee3-449f-908e-254953c0d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5806438f-8ee3-449f-908e-254953c0d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-924793883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dcc80a-24f6-42be-97dd-0ec59fc1bb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b7f603121f4394a3bd7496f26c2f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:45Z,use_quota=True,user_id='bcf38cf0a0054e1db64d0e1a453b2b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(045f28b7-60c3-499a-9d98-72cdbaba730a),volume_type_id=045f28b7-60c3-499a-9d98-72cdbaba730a)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1914d1-cdf4-4a63-82eb-ea3e6fbc90c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1914d1-cdf4-4a63-82eb-ea3e6fbc90c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b968086-61a7-4b42-8e9c-88eb545c708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b968086-61a7-4b42-8e9c-88eb545c708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dcc80a-24f6-42be-97dd-0ec59fc1bb80', 'volume_name': 'volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d41f68-c3ea-41ed-b390-ddef5ac3f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d41f68-c3ea-41ed-b390-ddef5ac3f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a26f490-dabf-41f6-8cb8-694ed5994289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Volume c2dcc80a-24f6-42be-97dd-0ec59fc1bb80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80', 'volume_size': 1}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-f3083171-7542-4468-8682-faa00d9d5132-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "cinder-f3083171-7542-4468-8682-faa00d9d5132-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d04f27-8400-49a1-9f9f-319f9cc16869]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b686c1fb-8407-40c5-9bde-727733eb1c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ab19944-240b-4bb5-bc77-b3b982ef39d1', 'volume_name': 'volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1', 'volume_size': 1, 'image_id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1440965682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43279078f8ad4f7fae37f03fd6ab3ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'created_at': datetime.datetime(2026, 6, 29, 2, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8736c6c60>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e602be-bc9a-4088-a529-2e1d30d844b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e602be-bc9a-4088-a529-2e1d30d844b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d932821-a3f9-4387-a6aa-066f92465d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1', 'volume_size': 1, 'image_id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1440965682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43279078f8ad4f7fae37f03fd6ab3ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'created_at': datetime.datetime(2026, 6, 29, 2, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8736c6c60>}
Jun 29 04:53:45 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Trying to clone 6ab19944-240b-4bb5-bc77-b3b982ef39d1 from image bc604a05-b0df-45ec-bf82-aa3cab196a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 04:53:45 devstack sudo[104066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132
Jun 29 04:53:45 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:46 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 1073741824" returned: 0 in 1.035s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:46 devstack sudo[104069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47
Jun 29 04:53:46 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:46 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132" returned: 0 in 0.877s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:46 devstack sudo[104081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132
Jun 29 04:53:46 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:46 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47" returned: 0 in 0.670s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1965811444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e73756-a2ec-40f7-b1df-251ee40a5d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce20989-bcd7-4ce4-8f78-416e360d8d6a),volume_type_id=5ce20989-bcd7-4ce4-8f78-416e360d8d6a)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Creating volume d9e73756-a2ec-40f7-b1df-251ee40a5d75 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:46 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:46 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 1073741824
Jun 29 04:53:46 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b447f673-711f-471c-b9da-9aaad37b56ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dabb62e-3ba6-45c1-b66f-626775b80c47', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65378be3-d9c3-4a28-9597-2390af96f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:46 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Volume volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 (1dabb62e-3ba6-45c1-b66f-626775b80c47): created successfully
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65378be3-d9c3-4a28-9597-2390af96f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (658e6808-fa2b-475d-9b13-742723e46ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6338e849-9ffb-43f1-9b14-be9fdf2c72ed tempest-TestInstancesWithCinderVolumes-302546399 None] Created volume successfully.
Jun 29 04:53:47 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3083171-7542-4468-8682-faa00d9d5132" returned: 0 in 0.695s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-f3083171-7542-4468-8682-faa00d9d5132" released by "delete_volume" :: held 1.622s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Created reservations ['6916a968-1dd6-4fb9-9d56-2ed0d5b10a62', 'a3e82d9e-011a-4c57-b19e-f88b4345921a', '92918738-8697-43df-be0d-ba7a1b691fc1', '7ee4f75f-9548-44b2-b7f3-950a427722bd'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:47 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:47 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:47 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 1073741824" returned: 0 in 0.909s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:47 devstack sudo[104093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75
Jun 29 04:53:47 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-4e17f678-3b9f-4eb2-b754-8b6ca862ef31-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "cinder-4e17f678-3b9f-4eb2-b754-8b6ca862ef31-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Acquiring lock "cinder-quobyte-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" acquired by "delete_volume" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c3fc6-26ec-4d46-83c2-3a1f3b7acee3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:48 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.737s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:48 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Deleted volume successfully.
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d26b3f53-c7d1-4c47-b2fa-7f05c3ee6891 tempest-VolumesCloneTest-162653605 None] Lock "cinder-f3083171-7542-4468-8682-faa00d9d5132-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:48 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:48 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:48 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75" returned: 0 in 0.763s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.864s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1676262933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b51186-ff21-4873-8f61-9b5b0c23ade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f59bcd193a4c92b78add67dcf340f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:44Z,use_quota=True,user_id='c2e637d978aa49fe91e45cf0a05ff03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Creating volume f6b51186-ff21-4873-8f61-9b5b0c23ade2 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:48 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:48 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 1073741824
Jun 29 04:53:48 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a67773-919f-4c50-be91-000f0511c213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c03bbe-c63a-4d3e-89db-1c5e3fac7d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:48 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Volume volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 (d9e73756-a2ec-40f7-b1df-251ee40a5d75): created successfully
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c03bbe-c63a-4d3e-89db-1c5e3fac7d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (57312cbf-cb15-4caf-aa8b-377412fa33bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:48 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-25d59c82-a366-423b-b404-95133df44a04 tempest-TestInstancesWithCinderVolumes-302546399 None] Created volume successfully.
Jun 29 04:53:49 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 0.879s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:49 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31
Jun 29 04:53:49 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:49 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 1073741824" returned: 0 in 0.927s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:49 devstack sudo[104110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2
Jun 29 04:53:49 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD, size 20.69 MB, duration 3.81 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 04:53:49 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Image download 20.69 MB at 5.44 MB/s
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32dcf2-883e-4d92-b368-dd5cb301e348]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:49 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" returned: 0 in 0.691s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "cinder-quobyte-4e17f678-3b9f-4eb2-b754-8b6ca862ef31" released by "delete_volume" :: held 1.632s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:49 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD
Jun 29 04:53:49 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Created reservations ['aa3e30ec-b16c-4c13-bb0c-fe2e759df87b', '3ea6cc1b-9122-44d0-97c0-7723ce172c38', 'c233d581-b18d-4d07-8b5d-7ebb0dfa5909', 'cb47715e-fae2-4d14-9ce8-c47ddffed6e9'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:49 devstack sudo[104115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:49 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:50 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2" returned: 0 in 0.705s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.726s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-924793883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dcc80a-24f6-42be-97dd-0ec59fc1bb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b7f603121f4394a3bd7496f26c2f9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:45Z,use_quota=True,user_id='bcf38cf0a0054e1db64d0e1a453b2b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(045f28b7-60c3-499a-9d98-72cdbaba730a),volume_type_id=045f28b7-60c3-499a-9d98-72cdbaba730a)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Creating volume c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:50 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41dd27a-3a66-4e7d-82e3-ca91321509c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:50 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 1073741824
Jun 29 04:53:50 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e271c29-eece-4eba-bfa2-82970f469923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Volume volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 (f6b51186-ff21-4873-8f61-9b5b0c23ade2): created successfully
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e271c29-eece-4eba-bfa2-82970f469923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Flow 'volume_create_manager' (5a63bddb-297d-47cd-b5fa-aa202886a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-02452ec2-ea2a-475c-aceb-1005646aa3ea tempest-VolumesMetadataTest-1901411571 None] Created volume successfully.
Jun 29 04:53:50 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Temporary image bc604a05-b0df-45ec-bf82-aa3cab196a7c is fetched for user 46f98059989c45dd801c2a8f1423f917. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 04:53:50 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.728s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Deleted volume successfully.
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-befbb87d-7ed0-4f6b-bb20-3c517135ddaa tempest-VolumesCloneTest-162653605 None] Lock "cinder-4e17f678-3b9f-4eb2-b754-8b6ca862ef31-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3c8496-5c54-4626-a097-ee34d8387b1b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:50 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD
Jun 29 04:53:50 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:51 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 1073741824" returned: 0 in 1.050s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:51 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80
Jun 29 04:53:51 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:51 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Acquiring lock "cinder-f6b51186-ff21-4873-8f61-9b5b0c23ade2-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "cinder-f6b51186-ff21-4873-8f61-9b5b0c23ade2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:52 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" returned: 0 in 0.856s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-573041424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab19944-240b-4bb5-bc77-b3b982ef39d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43279078f8ad4f7fae37f03fd6ab3ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:45Z,use_quota=True,user_id='46f98059989c45dd801c2a8f1423f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad72602-558b-4180-be3b-b554816fc9a5),volume_type_id=aad72602-558b-4180-be3b-b554816fc9a5)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Creating volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:52 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:52 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1073741824
Jun 29 04:53:52 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a26f490-dabf-41f6-8cb8-694ed5994289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90a49e4-5e2d-463d-9f49-8241af5e74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Acquiring lock "cinder-quobyte-f6b51186-ff21-4873-8f61-9b5b0c23ade2" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Volume volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 (c2dcc80a-24f6-42be-97dd-0ec59fc1bb80): created successfully
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90a49e4-5e2d-463d-9f49-8241af5e74c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Flow 'volume_create_manager' (616932c7-c46d-48b0-ae80-39dcd119840d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "cinder-quobyte-f6b51186-ff21-4873-8f61-9b5b0c23ade2" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8527f28c-4153-483a-9071-e70083dcc320 tempest-VolumeTypesAccessTest-1034960106 None] Created volume successfully.
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a08a9f-2cb1-4292-a69e-9580447b9309]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:52 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2
Jun 29 04:53:52 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Acquiring lock "cinder-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "cinder-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Acquiring lock "cinder-quobyte-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "cinder-quobyte-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5184c-b8ee-49ed-b643-85d40d1b1017]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:53 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1073741824" returned: 0 in 0.975s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:53 devstack sudo[104145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80
Jun 29 04:53:53 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:53 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2" returned: 0 in 0.931s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:53 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:53:53 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:53 devstack sudo[104151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2
Jun 29 04:53:53 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:53 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" returned: 0 in 0.858s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:53 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80
Jun 29 04:53:53 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:53 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Flow 'volume_create_manager' (9fefa72e-a2ee-441b-b415-48706af9e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb32ffb-0540-417e-9523-19c9ecabde41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:54 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f6b51186-ff21-4873-8f61-9b5b0c23ade2" returned: 0 in 0.763s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb32ffb-0540-417e-9523-19c9ecabde41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-860506387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015540ef-8aad-481d-b651-c08563d0fee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2666246250984ffeba1e7db030b65d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:54Z,use_quota=True,user_id='c3481c096cdb45598a33d87626b60db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115e10cf-db9c-4e18-905b-2d5932194b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115e10cf-db9c-4e18-905b-2d5932194b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3d85a-9148-4f2b-99a0-d7589bfe152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3d85a-9148-4f2b-99a0-d7589bfe152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015540ef-8aad-481d-b651-c08563d0fee3', 'volume_name': 'volume-015540ef-8aad-481d-b651-c08563d0fee3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563fff71-fb80-4b95-8aec-5ba0b8c670bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563fff71-fb80-4b95-8aec-5ba0b8c670bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db798e2-9c34-441e-b611-6220220d917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Volume 015540ef-8aad-481d-b651-c08563d0fee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015540ef-8aad-481d-b651-c08563d0fee3', 'volume_size': 1}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "cinder-quobyte-f6b51186-ff21-4873-8f61-9b5b0c23ade2" released by "delete_volume" :: held 1.793s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:54 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 0.892s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-860506387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015540ef-8aad-481d-b651-c08563d0fee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2666246250984ffeba1e7db030b65d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:53:54Z,use_quota=True,user_id='c3481c096cdb45598a33d87626b60db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Creating volume 015540ef-8aad-481d-b651-c08563d0fee3 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:53:54 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:54 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 1073741824
Jun 29 04:53:54 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Attempting download of bc604a05-b0df-45ec-bf82-aa3cab196a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}])) to volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Created reservations ['11c641ee-a3a7-4573-b518-488a4e821cf1', '6f2fb80c-e760-4f24-947a-db70250801e0', '37a06d15-07e8-408a-9e9d-424b58b0de91', 'a11e3a44-ddc6-48df-bb15-3458c6b9967f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d561f6d-7fd5-4d03-9ad4-8ee91360b6e9]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:54 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:54 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:54 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h
Jun 29 04:53:54 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:54 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" returned: 0 in 1.000s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "cinder-quobyte-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80" released by "delete_volume" :: held 1.915s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:55 devstack cinder-volume[93723]: WARNING cinder.quota [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-623716806 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-623716806, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:53:55 devstack cinder-volume[93723]: WARNING cinder.quota [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-623716806 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-623716806, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Created reservations ['8d490c36-1f4e-4132-86cb-449e5e04f359', 'e381b635-09d2-4490-acbf-d0aa575104bf', '71d8ba59-4275-4379-8a35-c898dbb02150', 'a0a96ebe-d8e7-4682-84c8-b99808b7a52a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:53:55 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h" returned: 0 in 0.876s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:55 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:53:55 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:55 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 1073741824" returned: 0 in 1.139s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:55 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.043s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:55 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h
Jun 29 04:53:55 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Deleted volume successfully.
Jun 29 04:53:55 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3
Jun 29 04:53:55 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-958b9289-860f-4985-9f13-6df5360f60b7 tempest-VolumesMetadataTest-1901411571 None] Lock "cinder-f6b51186-ff21-4873-8f61-9b5b0c23ade2-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:56 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3" returned: 0 in 0.939s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db798e2-9c34-441e-b611-6220220d917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015540ef-8aad-481d-b651-c08563d0fee3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99abcb30-37d1-4d86-aed4-ec12da1ca3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:53:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Volume volume-015540ef-8aad-481d-b651-c08563d0fee3 (015540ef-8aad-481d-b651-c08563d0fee3): created successfully
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99abcb30-37d1-4d86-aed4-ec12da1ca3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Flow 'volume_create_manager' (9fefa72e-a2ee-441b-b415-48706af9e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:53:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-52028e49-0e65-41f5-8df9-d3f4793b8e90 tempest-VolumesNegativeTest-981937150 None] Created volume successfully.
Jun 29 04:53:56 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h" returned: 1 in 1.265s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ak5l4x6h' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5018f85-2a5c-4d51-a88b-a9be5c280d46]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:56 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.260s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:53:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Deleted volume successfully.
Jun 29 04:53:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31716866-3766-4103-a512-dbe21c5d1198 tempest-VolumeTypesAccessTest-1034960106 None] Lock "cinder-c2dcc80a-24f6-42be-97dd-0ec59fc1bb80-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:53:56 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD
Jun 29 04:53:56 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:57 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:57 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] bc604a05-b0df-45ec-bf82-aa3cab196a7c was qcow2, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 04:53:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:53:57 devstack sudo[104191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:53:57 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:53:59 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root
Jun 29 04:53:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 2.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:53:59 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc604a05-b0df-45ec-bf82-aa3cab196a7c_ld7sp6zrdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:53:59 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Converted 112.00 MB image at 41.89 MB/s
Jun 29 04:53:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:00 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1G
Jun 29 04:54:00 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:00 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 1G" returned: 0 in 0.788s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a841b-2b4b-4bb9-a512-79f6261ee521]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Flow 'volume_create_manager' (bb65badc-35b7-4cd0-bcdf-9471ffb6fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:00 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:54:00 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e618a572-bcbb-4be2-bcbd-78643df8f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e618a572-bcbb-4be2-bcbd-78643df8f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-343640403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b67240-771f-4323-a3d6-598b54ffca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df001413310045ffa3de9200bbc3f96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:01Z,use_quota=True,user_id='ecc395b5622c4d9b945228388d9831d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baedf3d-60e4-48bc-9f05-68233aaca792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baedf3d-60e4-48bc-9f05-68233aaca792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eaa825-99a0-4216-9dad-a88d8a2a4bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eaa825-99a0-4216-9dad-a88d8a2a4bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b67240-771f-4323-a3d6-598b54ffca6e', 'volume_name': 'volume-45b67240-771f-4323-a3d6-598b54ffca6e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeda4e4b-72d3-4412-be78-ad1715eea9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeda4e4b-72d3-4412-be78-ad1715eea9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08040174-c454-4708-8a3d-8e0cd9100a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Volume 45b67240-771f-4323-a3d6-598b54ffca6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b67240-771f-4323-a3d6-598b54ffca6e', 'volume_size': 1}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-343640403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b67240-771f-4323-a3d6-598b54ffca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df001413310045ffa3de9200bbc3f96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:01Z,use_quota=True,user_id='ecc395b5622c4d9b945228388d9831d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Creating volume 45b67240-771f-4323-a3d6-598b54ffca6e {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:54:01 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:01 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e 1073741824
Jun 29 04:54:01 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:01 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 0.948s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:01 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:54:01 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:02 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e 1073741824" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:02 devstack sudo[104224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e
Jun 29 04:54:02 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:02 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 1 in 0.916s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Downloaded image bc604a05-b0df-45ec-bf82-aa3cab196a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}])) to volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1 successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Temporary image bc604a05-b0df-45ec-bf82-aa3cab196a7c for user 46f98059989c45dd801c2a8f1423f917 is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Marking volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1 as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Copying metadata from image bc604a05-b0df-45ec-bf82-aa3cab196a7c to 6ab19944-240b-4bb5-bc77-b3b982ef39d1. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Creating volume glance metadata for volume 6ab19944-240b-4bb5-bc77-b3b982ef39d1 backed by image bc604a05-b0df-45ec-bf82-aa3cab196a7c with: {'image_id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'image_name': 'tempest-scenario-img--1440965682', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d932821-a3f9-4387-a6aa-066f92465d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1', 'volume_size': 1, 'image_id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1440965682', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43279078f8ad4f7fae37f03fd6ab3ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc604a05-b0df-45ec-bf82-aa3cab196a7c', 'created_at': datetime.datetime(2026, 6, 29, 2, 53, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc604a05-b0df-45ec-bf82-aa3cab196a7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8736c6c60>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5db6c8-89a8-41e3-8bc2-37d7777c0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:02 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Volume volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 (6ab19944-240b-4bb5-bc77-b3b982ef39d1): created successfully
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5db6c8-89a8-41e3-8bc2-37d7777c0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Flow 'volume_create_manager' (dcbf6ea9-3664-49e9-9b00-7a99b1bf336b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:02 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a5252a30-611c-41bb-8c7f-39021b7b352f tempest-TestInstancesWithCinderVolumes-302546399 None] Created volume successfully.
Jun 29 04:54:02 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e" returned: 0 in 0.762s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08040174-c454-4708-8a3d-8e0cd9100a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b67240-771f-4323-a3d6-598b54ffca6e', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2034e9ab-7fb1-4798-804b-157fa662355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:02 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Volume volume-45b67240-771f-4323-a3d6-598b54ffca6e (45b67240-771f-4323-a3d6-598b54ffca6e): created successfully
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2034e9ab-7fb1-4798-804b-157fa662355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Flow 'volume_create_manager' (bb65badc-35b7-4cd0-bcdf-9471ffb6fd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:02 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-53f37479-64b4-4b0b-93f4-a6262a256153 tempest-VolumesTransfersV355Test-1339733267 None] Created volume successfully.
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:03 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:03 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:04 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.916s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:54:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:54:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:54:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-309e90f2-4a42-4014-ba55-3d96daa6b4cf tempest-VolumesTransfersV355Test-1647876536 None] Transfer volume completed successfully.
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "cinder-45b67240-771f-4323-a3d6-598b54ffca6e-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-45b67240-771f-4323-a3d6-598b54ffca6e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "cinder-quobyte-45b67240-771f-4323-a3d6-598b54ffca6e" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-quobyte-45b67240-771f-4323-a3d6-598b54ffca6e" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8755ed9-85b7-4591-b60c-1e96f1d9f684]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:06 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e
Jun 29 04:54:06 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:07 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e" returned: 0 in 0.934s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:07 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e
Jun 29 04:54:07 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:08 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45b67240-771f-4323-a3d6-598b54ffca6e" returned: 0 in 0.820s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-quobyte-45b67240-771f-4323-a3d6-598b54ffca6e" released by "delete_volume" :: held 1.814s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Created reservations ['1e55424b-f89a-4443-bdbf-1137246f4eee', '5f42feb6-e3c1-4196-8fc8-ebf4c5e85b58', 'd1a08a41-9fed-4527-a13a-a15cc77c3993', '01c2a068-3aac-499b-9b97-6d0fa75b0ac1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:08 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:08 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:09 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.053s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Deleted volume successfully.
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-160aeea0-7bf4-4b00-a383-c622318b6b66 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-45b67240-771f-4323-a3d6-598b54ffca6e-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Flow 'volume_create_manager' (736461d4-4541-47d1-97e7-09efb8025daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830a8acf-78e3-40a9-a867-3e9c0a7b5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830a8acf-78e3-40a9-a867-3e9c0a7b5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-102510316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f416ab-4938-48ae-a877-ccaedc263ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df001413310045ffa3de9200bbc3f96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:09Z,use_quota=True,user_id='ecc395b5622c4d9b945228388d9831d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436930b6-249c-4fe6-927e-f31c2d76ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436930b6-249c-4fe6-927e-f31c2d76ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022faa30-91b3-440e-82fd-1aa8e1410011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022faa30-91b3-440e-82fd-1aa8e1410011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f416ab-4938-48ae-a877-ccaedc263ad5', 'volume_name': 'volume-b3f416ab-4938-48ae-a877-ccaedc263ad5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6155b4a-74a3-4149-9898-dd0a62df4af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6155b4a-74a3-4149-9898-dd0a62df4af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe1c74b-8b9f-4883-84a1-9cc9d16c423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:09 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Volume b3f416ab-4938-48ae-a877-ccaedc263ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f416ab-4938-48ae-a877-ccaedc263ad5', 'volume_size': 1}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-102510316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f416ab-4938-48ae-a877-ccaedc263ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df001413310045ffa3de9200bbc3f96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:09Z,use_quota=True,user_id='ecc395b5622c4d9b945228388d9831d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Creating volume b3f416ab-4938-48ae-a877-ccaedc263ad5 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:54:09 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:54:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:09 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 1073741824
Jun 29 04:54:09 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:10 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 1073741824" returned: 0 in 1.001s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:10 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5
Jun 29 04:54:10 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:11 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5" returned: 0 in 0.852s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe1c74b-8b9f-4883-84a1-9cc9d16c423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f416ab-4938-48ae-a877-ccaedc263ad5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7cf0ef-c47e-4216-b3bb-d383f8844d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:11 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Volume volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 (b3f416ab-4938-48ae-a877-ccaedc263ad5): created successfully
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7cf0ef-c47e-4216-b3bb-d383f8844d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Flow 'volume_create_manager' (736461d4-4541-47d1-97e7-09efb8025daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3a234861-adcd-42e5-ac2a-ef6e78960020 tempest-VolumesTransfersV355Test-1339733267 None] Created volume successfully.
Jun 29 04:54:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "cinder-b3f416ab-4938-48ae-a877-ccaedc263ad5-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-b3f416ab-4938-48ae-a877-ccaedc263ad5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "cinder-quobyte-b3f416ab-4938-48ae-a877-ccaedc263ad5" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-quobyte-b3f416ab-4938-48ae-a877-ccaedc263ad5" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca4379-c2ef-4bff-af13-4acd9473275e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:13 devstack sudo[104315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5
Jun 29 04:54:13 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:14 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:14 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5
Jun 29 04:54:14 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9296813-bc1c-4131-98cb-efd19cbfab18]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:15 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b3f416ab-4938-48ae-a877-ccaedc263ad5" returned: 0 in 1.115s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:15 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:54:15 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-quobyte-b3f416ab-4938-48ae-a877-ccaedc263ad5" released by "delete_volume" :: held 2.113s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Created reservations ['797fc62f-8818-4378-9257-0a5cbc1c88f8', 'a98edeb5-849f-4d6e-a92a-60916edc93e1', '21303a09-b0bf-434e-b2b8-a9a3924be65c', '1aa296cf-5f98-4128-bdce-22fe78010c13'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:15 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:15 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:16 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 1.347s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:16 devstack sudo[104415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:54:16 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:16 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.363s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:16 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Deleted volume successfully.
Jun 29 04:54:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f45f598f-162e-411b-a69c-ba83566ad435 tempest-VolumesTransfersV355Test-1041624005 None] Lock "cinder-b3f416ab-4938-48ae-a877-ccaedc263ad5-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:17 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 1 in 1.233s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:54:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.652s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2ef6ede-955a-4f94-8084-f85419f508f8', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:54:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-f74f0963-5659-46e7-8df2-5cceffd775c2 req-d9982cbf-d6d3-4163-897f-8efdec3b48c7 tempest-TestInstancesWithCinderVolumes-302546399 None] attachment_update completed successfully.
Jun 29 04:54:25 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (cbe32773-7fdc-46ba-bfb4-7949df5c8303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c3a441-6544-4259-8382-998ffafa961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c3a441-6544-4259-8382-998ffafa961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-150239593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e804e760-2600-4c93-92a1-b26d40658d29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:26Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774eea56-6e5e-4a9e-bc25-8ba1a9e58ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774eea56-6e5e-4a9e-bc25-8ba1a9e58ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a9106d-1f8f-4c72-8804-c70e1f3deefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a9106d-1f8f-4c72-8804-c70e1f3deefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e804e760-2600-4c93-92a1-b26d40658d29', 'volume_name': 'volume-e804e760-2600-4c93-92a1-b26d40658d29', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ca56c2-3ff6-42f6-ab1a-3ff0bcc95fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ca56c2-3ff6-42f6-ab1a-3ff0bcc95fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4317c45d-fdc3-44a5-ad30-3b4203bcd864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Volume e804e760-2600-4c93-92a1-b26d40658d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e804e760-2600-4c93-92a1-b26d40658d29', 'volume_size': 1}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-150239593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e804e760-2600-4c93-92a1-b26d40658d29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:26Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Creating volume e804e760-2600-4c93-92a1-b26d40658d29 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:54:26 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:54:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:26 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 1073741824
Jun 29 04:54:26 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:28 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 1073741824" returned: 0 in 2.206s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:28 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29
Jun 29 04:54:28 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:29 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29" returned: 0 in 0.972s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] <== create_volume: return (3336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.341s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4317c45d-fdc3-44a5-ad30-3b4203bcd864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e804e760-2600-4c93-92a1-b26d40658d29', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f584d1-3bb8-41bb-8850-496c3a532668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:29 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Volume volume-e804e760-2600-4c93-92a1-b26d40658d29 (e804e760-2600-4c93-92a1-b26d40658d29): created successfully
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f584d1-3bb8-41bb-8850-496c3a532668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (cbe32773-7fdc-46ba-bfb4-7949df5c8303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:29 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f1c5a98b-b572-4aa0-acdc-3ebd9be11397 tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (d150d57d-818d-4787-a110-c191db7b4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d7ce96-59d5-410e-aa5a-9df103a9944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d7ce96-59d5-410e-aa5a-9df103a9944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-139348752',display_name='tempest-VolumesGetTest-Volume-1116257256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e2849e-a19e-4f75-baf7-34b26407c072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:32Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12491298-3901-4e1a-b1bc-461673b290fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12491298-3901-4e1a-b1bc-461673b290fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678f9d3e-93ac-40f3-b358-5388eb7f777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678f9d3e-93ac-40f3-b358-5388eb7f777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e2849e-a19e-4f75-baf7-34b26407c072', 'volume_name': 'volume-14e2849e-a19e-4f75-baf7-34b26407c072', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3834a6-00db-4cd4-8c67-47c5899258c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3834a6-00db-4cd4-8c67-47c5899258c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e9c5e-f65d-4455-b2f8-125987aea479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:32 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Volume 14e2849e-a19e-4f75-baf7-34b26407c072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e2849e-a19e-4f75-baf7-34b26407c072', 'volume_size': 1}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-139348752',display_name='tempest-VolumesGetTest-Volume-1116257256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e2849e-a19e-4f75-baf7-34b26407c072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:32Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Creating volume 14e2849e-a19e-4f75-baf7-34b26407c072 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:54:32 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:54:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:32 devstack sudo[104951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 1073741824
Jun 29 04:54:32 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:33 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 1073741824" returned: 0 in 1.442s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:33 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072
Jun 29 04:54:33 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:34 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072" returned: 0 in 0.852s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] <== create_volume: return (2374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e9c5e-f65d-4455-b2f8-125987aea479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e2849e-a19e-4f75-baf7-34b26407c072', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1364164f-ace1-4630-bd14-922408d85d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:34 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Volume volume-14e2849e-a19e-4f75-baf7-34b26407c072 (14e2849e-a19e-4f75-baf7-34b26407c072): created successfully
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1364164f-ace1-4630-bd14-922408d85d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (d150d57d-818d-4787-a110-c191db7b4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-48219c58-442e-40dc-8342-91ec3cb134f3 tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-14e2849e-a19e-4f75-baf7-34b26407c072-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "cinder-14e2849e-a19e-4f75-baf7-34b26407c072-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-14e2849e-a19e-4f75-baf7-34b26407c072" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-14e2849e-a19e-4f75-baf7-34b26407c072" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477254e-272d-4b2f-a012-9fd32d791521]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:35 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072
Jun 29 04:54:35 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:36 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072" returned: 0 in 1.360s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:36 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072
Jun 29 04:54:36 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:37 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-14e2849e-a19e-4f75-baf7-34b26407c072" returned: 0 in 0.776s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-14e2849e-a19e-4f75-baf7-34b26407c072" released by "delete_volume" :: held 2.212s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Created reservations ['5e1d1682-550b-4c33-a400-8b6386f086ee', 'b87e201c-7595-4169-83d7-df3da1f2a1a6', '7702bc38-03e1-4d9b-bcfc-f277102e220c', '853435dd-f26b-42fb-835e-940523641494'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:37 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:37 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:38 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.098s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-e804e760-2600-4c93-92a1-b26d40658d29-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "cinder-e804e760-2600-4c93-92a1-b26d40658d29-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6733a0ff-d926-4244-9504-087b27684a75 tempest-VolumesGetTest-1231824455 None] Lock "cinder-14e2849e-a19e-4f75-baf7-34b26407c072-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-e804e760-2600-4c93-92a1-b26d40658d29" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e804e760-2600-4c93-92a1-b26d40658d29" acquired by "delete_volume" :: waited 0.039s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[798ac617-1ea2-4bb5-aca8-3d96527b74de]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:39 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29
Jun 29 04:54:39 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:39 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29" returned: 0 in 1.020s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:39 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29
Jun 29 04:54:39 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:40 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e804e760-2600-4c93-92a1-b26d40658d29" returned: 0 in 0.742s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e804e760-2600-4c93-92a1-b26d40658d29" released by "delete_volume" :: held 1.830s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Created reservations ['e911ec2a-97cc-4fd8-9386-4336090445a9', '5a57b97d-03aa-4c00-8fec-1e145c2c746f', '71a2ae15-bb97-4e80-8801-feec82be4d0d', 'b562ebe6-ab5e-48e9-b246-e11d57642833'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:41 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:41 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (1a8a3f94-8a5a-4f29-a843-b7b535eefe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b9505c-1f62-4aae-88e8-5e2ed117f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b9505c-1f62-4aae-88e8-5e2ed117f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-840834336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f7b320-85e8-47d7-8d3e-bff204a0fda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:42Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0622b1-d47e-42c9-9667-901300ca12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:42 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0622b1-d47e-42c9-9667-901300ca12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448e88c7-c38f-4ad2-96dd-4aff0ff3410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448e88c7-c38f-4ad2-96dd-4aff0ff3410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'volume_name': 'volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf4b64b-e225-4cf5-9ac6-3083bfb5bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf4b64b-e225-4cf5-9ac6-3083bfb5bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628c8651-7fb2-4922-8a0b-ec3eb72b5ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:42 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Volume e4f7b320-85e8-47d7-8d3e-bff204a0fda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'volume_size': 1}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-840834336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f7b320-85e8-47d7-8d3e-bff204a0fda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:42Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Creating volume e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:54:42 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.530s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:42 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:54:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-23c05cde-fe0f-4b50-a376-3ace2658938e tempest-VolumesGetTest-1231824455 None] Lock "cinder-e804e760-2600-4c93-92a1-b26d40658d29-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:42 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 1073741824
Jun 29 04:54:42 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:44 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 1073741824" returned: 0 in 1.628s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=72,cinder:UPDATE=101,cinder:DELETE=7,cinder:INSERT=29 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=76,cinder:UPDATE=101,cinder:INSERT=23,cinder:DELETE=12 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:44 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:54:44 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:44 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 0.811s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:54:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628c8651-7fb2-4922-8a0b-ec3eb72b5ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aa8a3c-ce2c-4afe-b26c-b3ce80dcdfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Volume volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 (e4f7b320-85e8-47d7-8d3e-bff204a0fda8): created successfully
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aa8a3c-ce2c-4afe-b26c-b3ce80dcdfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (1a8a3f94-8a5a-4f29-a843-b7b535eefe85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-98ba0b02-88dc-4e17-ba4d-5461a57e0346 tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (0729c125-e535-4b8a-b2b3-cefd4bd98d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d4c7be-d6c8-4b07-8ec1-1c3297701eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d4c7be-d6c8-4b07-8ec1-1c3297701eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1057387245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6803cb82-d4a1-4a12-88f9-7d7399f1acb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e4f7b320-85e8-47d7-8d3e-bff204a0fda8,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:46Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0963667-fca0-40c7-ab87-dbd78731bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0963667-fca0-40c7-ab87-dbd78731bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81fe989-89da-41a4-a2b6-d56ee366abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81fe989-89da-41a4-a2b6-d56ee366abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6803cb82-d4a1-4a12-88f9-7d7399f1acb6', 'volume_name': 'volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6', 'volume_size': 1, 'source_volid': 'e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'source_volstatus': 'available'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b68adb8-fedf-49b9-a674-2c0bdf03c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b68adb8-fedf-49b9-a674-2c0bdf03c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b023be2d-4733-487d-8902-c22b3638d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:46 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Volume 6803cb82-d4a1-4a12-88f9-7d7399f1acb6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6', 'volume_size': 1, 'source_volid': 'e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'source_volstatus': 'available'}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:46 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Cloning volume e4f7b320-85e8-47d7-8d3e-bff204a0fda8 to volume 6803cb82-d4a1-4a12-88f9-7d7399f1acb6
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Creating offline snapshot e77ebaee-4737-4aba-9e88-138223ada410 of volume e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c60cc6-a144-469a-94f6-d7fb84cf5075]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:46 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:54:46 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Acquiring lock "cinder-015540ef-8aad-481d-b651-c08563d0fee3-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "cinder-015540ef-8aad-481d-b651-c08563d0fee3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Acquiring lock "cinder-quobyte-015540ef-8aad-481d-b651-c08563d0fee3" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "cinder-quobyte-015540ef-8aad-481d-b651-c08563d0fee3" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc0daa-f3bd-4213-b83d-de9119fec97e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:46 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:47 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 1G
Jun 29 04:54:47 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:47 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3
Jun 29 04:54:47 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:47 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3" returned: 0 in 0.771s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:47 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3
Jun 29 04:54:47 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:47 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 1G" returned: 0 in 0.837s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:47 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:54:47 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:48 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-015540ef-8aad-481d-b651-c08563d0fee3" returned: 0 in 0.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "cinder-quobyte-015540ef-8aad-481d-b651-c08563d0fee3" released by "delete_volume" :: held 1.486s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Created reservations ['1d89ae7f-aea6-460d-905d-a43234a8f66d', 'e842a1ec-de15-452b-8308-c08f7f127bdd', 'e53a761a-dca9-4bf7-8901-507d7b4a777a', '73f038c5-e4d2-4dea-8099-714d00eb5109'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:54:48 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 0.745s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:48 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 is being set with open permissions: ugo+rw
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:48 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:54:48 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:48 devstack sudo[105151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:54:48 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:48 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:49 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.700s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:49 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:54:49 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Deleted volume successfully.
Jun 29 04:54:49 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 0.751s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a58bf0e6-6828-40aa-91e3-58961927163b tempest-VolumesNegativeTest-981937150 None] Lock "cinder-015540ef-8aad-481d-b651-c08563d0fee3-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:54:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:49 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info
Jun 29 04:54:49 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:50 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info" returned: 0 in 1.055s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:50 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info is being set with open permissions: ugo+rw
Jun 29 04:54:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:50 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info
Jun 29 04:54:50 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:51 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.info" returned: 0 in 0.946s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] snapshot: e77ebaee-4737-4aba-9e88-138223ada410, volume: 6803cb82-d4a1-4a12-88f9-7d7399f1acb6,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a725cf9-6024-4fcb-86db-ae139f197cdb]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:51 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:54:51 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:52 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 1.151s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad88243-f673-4cfe-8c60-811ff68911d6]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:54:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:52 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:54:52 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:54 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jun 29 04:54:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 1.519s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:54:54 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:54:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:54:54 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6
Jun 29 04:54:54 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (d9f4cc0d-6e4a-4122-8cac-e1e4eb475d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a6aba-1796-484e-aa3e-21f8c841b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a6aba-1796-484e-aa3e-21f8c841b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602067166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae554ea-dfa7-4037-8763-cd99e4338489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:55Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f283d610-74b3-48f8-a25f-aec68b8bdd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f283d610-74b3-48f8-a25f-aec68b8bdd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bdf6a-5fe7-423e-82f1-0b67353067c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bdf6a-5fe7-423e-82f1-0b67353067c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae554ea-dfa7-4037-8763-cd99e4338489', 'volume_name': 'volume-fae554ea-dfa7-4037-8763-cd99e4338489', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bd558d-9cdd-445a-a63c-79251710e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bd558d-9cdd-445a-a63c-79251710e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a87446-77c1-44b9-b8ba-8044148748ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:54:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Volume fae554ea-dfa7-4037-8763-cd99e4338489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae554ea-dfa7-4037-8763-cd99e4338489', 'volume_size': 1}
Jun 29 04:54:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:54:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:01 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" returned: 0 in 7.518s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:01 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[78016f27-a747-496f-ae44-31af43033b66]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:01 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:55:01 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:02 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 1.103s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:02 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:55:02 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Converted 1024.00 MB image at 136.18 MB/s
Jun 29 04:55:02 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 is being set with open permissions: ugo+rw
Jun 29 04:55:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:02 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6
Jun 29 04:55:02 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:03 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:03 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:04 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" returned: 0 in 1.352s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" released by "_copy_volume_from_snapshot" :: held 12.807s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-e77ebaee-4737-4aba-9e88-138223ada410" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e77ebaee-4737-4aba-9e88-138223ada410" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Deleting offline snapshot e77ebaee-4737-4aba-9e88-138223ada410 of volume e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] snapshot_file for this snap is: volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8af30-a238-408c-b123-01a8be97003e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:04 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:55:04 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:04 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.226s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:55:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:55:05 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 0.911s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:55:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa32c6e-f8d3-4fd1-b2c3-83261dada9ee]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:05 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:55:05 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:06 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 0.930s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:06 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:55:06 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:06 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=14,cinder:INSERT=1,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:55:07 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 0.862s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:07 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410
Jun 29 04:55:07 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:08 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8.e77ebaee-4737-4aba-9e88-138223ada410" returned: 0 in 0.918s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e77ebaee-4737-4aba-9e88-138223ada410" released by "_delete_snapshot" :: held 3.790s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.084s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602067166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae554ea-dfa7-4037-8763-cd99e4338489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:54:55Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Creating volume fae554ea-dfa7-4037-8763-cd99e4338489 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:08 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:08 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 1073741824
Jun 29 04:55:08 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b023be2d-4733-487d-8902-c22b3638d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6', 'volume_size': 1, 'source_volid': 'e4f7b320-85e8-47d7-8d3e-bff204a0fda8', 'source_volstatus': 'available'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341df04f-5da3-44e3-a25b-32c31b5b4fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:08 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Volume volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 (6803cb82-d4a1-4a12-88f9-7d7399f1acb6): created successfully
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341df04f-5da3-44e3-a25b-32c31b5b4fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (0729c125-e535-4b8a-b2b3-cefd4bd98d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-aa7329a8-4723-426f-b6c4-fc7fdca22dc8 tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:55:09 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 1073741824" returned: 0 in 0.985s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:09 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489
Jun 29 04:55:09 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (183c2a13-d4bd-4653-aca3-70ae4fc9f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185cdb04-cd76-473e-ac6e-d2c7a9128f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185cdb04-cd76-473e-ac6e-d2c7a9128f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1789710120',display_name='tempest-VolumesGetTest-Volume-547262897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c39a3d2-dfce-4a0a-b656-1e97dad2cc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:10Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d1cb6c-a750-4616-a998-b6cb32d164f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d1cb6c-a750-4616-a998-b6cb32d164f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00421128-bce1-4c97-aefc-3831f3c15679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00421128-bce1-4c97-aefc-3831f3c15679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c39a3d2-dfce-4a0a-b656-1e97dad2cc73', 'volume_name': 'volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d1838-cb67-4345-a98d-451b4e00f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d1838-cb67-4345-a98d-451b4e00f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d29247c-82dd-4e47-a459-ff98ac99a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Volume 6c39a3d2-dfce-4a0a-b656-1e97dad2cc73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73', 'volume_size': 1}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:09 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489" returned: 0 in 0.736s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.033s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a87446-77c1-44b9-b8ba-8044148748ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae554ea-dfa7-4037-8763-cd99e4338489', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77dc57-2934-46e1-9f71-d695285c693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[430804ff-7042-4f67-ac99-e6f137cc0534]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Volume volume-fae554ea-dfa7-4037-8763-cd99e4338489 (fae554ea-dfa7-4037-8763-cd99e4338489): created successfully
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77dc57-2934-46e1-9f71-d695285c693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (d9f4cc0d-6e4a-4122-8cac-e1e4eb475d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2a6f373d-8b9c-4dc8-b14c-92adc891d880 tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:55:10 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47
Jun 29 04:55:10 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:10 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47" returned: 0 in 0.974s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1789710120',display_name='tempest-VolumesGetTest-Volume-547262897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c39a3d2-dfce-4a0a-b656-1e97dad2cc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:10Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Creating volume 6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:10 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:11 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 1073741824
Jun 29 04:55:11 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-1dabb62e-3ba6-45c1-b66f-626775b80c47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d5acc9b-20c1-4f39-af80-fb39637bbd0f', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:55:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-72e77483-9f06-4d71-9a59-014e49f52505 req-3d794d67-0902-41de-adae-63bdb56c961c tempest-TestInstancesWithCinderVolumes-302546399 None] attachment_update completed successfully.
Jun 29 04:55:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f8f0080d-6b2e-4ba8-9fca-77b2ddb6a8cd tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489" by "attach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f8f0080d-6b2e-4ba8-9fca-77b2ddb6a8cd tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489" acquired by "attach_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f8f0080d-6b2e-4ba8-9fca-77b2ddb6a8cd tempest-VolumesActionsTest-1714921824 None] Attaching volume fae554ea-dfa7-4037-8763-cd99e4338489 to instance 6885eb50-9ddd-46f6-b6ae-101036a1ea25 at mountpoint /dev/vdb on host None.
Jun 29 04:55:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f8f0080d-6b2e-4ba8-9fca-77b2ddb6a8cd tempest-VolumesActionsTest-1714921824 None] Attach volume completed successfully.
Jun 29 04:55:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f8f0080d-6b2e-4ba8-9fca-77b2ddb6a8cd tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489" released by "attach_volume" :: held 0.131s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:12 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 1073741824" returned: 0 in 1.365s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:12 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73
Jun 29 04:55:12 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Terminate volume connection completed successfully.
Jun 29 04:55:13 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" returned: 0 in 0.859s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d29247c-82dd-4e47-a459-ff98ac99a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114bef3-b192-4c47-96ee-6c9915d60253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:13 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Volume volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 (6c39a3d2-dfce-4a0a-b656-1e97dad2cc73): created successfully
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7114bef3-b192-4c47-96ee-6c9915d60253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (183c2a13-d4bd-4653-aca3-70ae4fc9f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" by "detach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bc041a57-c1a5-4aa7-ba2d-f03e61a447ad tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Detaching volume fae554ea-dfa7-4037-8763-cd99e4338489 from instance 6885eb50-9ddd-46f6-b6ae-101036a1ea25.
Jun 29 04:55:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Detach volume completed successfully.
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1eac99b2-66e5-4012-8e52-a62a0416f15f tempest-VolumesActionsTest-1972814227 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e910e48b-89c7-4bf6-bd30-8078d8225e62 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" by "detach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e910e48b-89c7-4bf6-bd30-8078d8225e62 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e910e48b-89c7-4bf6-bd30-8078d8225e62 tempest-VolumesActionsTest-1714921824 None] Volume detach called, but volume not attached.
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e910e48b-89c7-4bf6-bd30-8078d8225e62 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "cinder-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16339b-7733-459a-81d7-868c2ac122b2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:14 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73
Jun 29 04:55:14 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-quobyte-fae554ea-dfa7-4037-8763-cd99e4338489" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-quobyte-fae554ea-dfa7-4037-8763-cd99e4338489" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf86751a-76d9-4394-b2b8-e38ad9fced26]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:15 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489
Jun 29 04:55:15 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:15 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" returned: 0 in 0.860s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:15 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73
Jun 29 04:55:15 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:15 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489" returned: 0 in 0.934s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:15 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489
Jun 29 04:55:15 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:16 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" returned: 0 in 1.027s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73" released by "delete_volume" :: held 1.940s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Created reservations ['b146da4b-db82-4c71-beaa-9a5ea2c4ace2', '2a50de96-f83c-4f8c-a1f8-a359c3f498dc', 'eb94b812-b5fc-419c-8ba9-9a94b8399834', '73f4ccf6-e1bf-49ba-a80e-f49ea768b3dc'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:16 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:16 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-6803cb82-d4a1-4a12-88f9-7d7399f1acb6-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-6803cb82-d4a1-4a12-88f9-7d7399f1acb6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fae554ea-dfa7-4037-8763-cd99e4338489" returned: 0 in 1.228s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:17 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" acquired by "delete_volume" :: waited 0.057s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-quobyte-fae554ea-dfa7-4037-8763-cd99e4338489" released by "delete_volume" :: held 2.288s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65599fb-cad0-4407-914f-aaf89910fce1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Created reservations ['4763df0c-7cbb-451c-b453-a3e1e409c83d', '4bd8c8dc-144c-4ac4-a17b-3cd62b779fc7', 'f6574abc-cf2b-4799-be8f-193ecea91a07', 'dd6ccb7f-cdd0-4c91-8f9c-5599e8bb61a3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:17 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6
Jun 29 04:55:17 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:17 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:17 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:17 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.091s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:55:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3789257c-ee0e-496e-9191-1bd9dd23ed24 tempest-VolumesGetTest-1231824455 None] Lock "cinder-6c39a3d2-dfce-4a0a-b656-1e97dad2cc73-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:18 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" returned: 0 in 0.986s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:18 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.753s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:18 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:18 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Deleted volume successfully.
Jun 29 04:55:18 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6
Jun 29 04:55:18 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c7c68469-842d-48fa-aeaf-7b20889dd1d2 tempest-VolumesActionsTest-1714921824 None] Lock "cinder-fae554ea-dfa7-4037-8763-cd99e4338489-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:19 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" returned: 0 in 0.876s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-6803cb82-d4a1-4a12-88f9-7d7399f1acb6" released by "delete_volume" :: held 1.944s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Created reservations ['4cada230-c729-4b38-a948-d6b0ea20bae1', '983a4ccb-e17d-4ea3-a552-07a3c589522c', '46eeb373-2aac-4f29-94cf-ce26f5d32d8c', '0da87edf-deff-4527-b169-e709a9511bea'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:19 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:19 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-e4f7b320-85e8-47d7-8d3e-bff204a0fda8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "cinder-e4f7b320-85e8-47d7-8d3e-bff204a0fda8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" acquired by "delete_volume" :: waited 0.062s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[662dfef0-8b3a-43de-b3d0-67f5e5ff3dc9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:19 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:55:19 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:20 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.612s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:20 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:55:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-251a3f96-3fd9-4a5b-945d-5714e7ae8c87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-6803cb82-d4a1-4a12-88f9-7d7399f1acb6-delete_volume" released by "delete_volume" :: held 3.977s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb755bf5-a5f5-4146-9004-c20a3774274b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:21 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 1.522s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:21 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8
Jun 29 04:55:21 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:21 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75
Jun 29 04:55:21 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:22 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" returned: 0 in 0.896s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-e4f7b320-85e8-47d7-8d3e-bff204a0fda8" released by "delete_volume" :: held 2.536s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Created reservations ['c36f52f1-815c-4b6c-8e4b-2b4250194bd9', '4771a944-adb0-4d55-b29a-d1dafc5483a5', 'c2fe23ac-5971-46b6-84a5-73498c912a25', '0bc0018e-09e3-40cc-b4fb-a4d446a15fb0'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:22 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:22 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:22 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75" returned: 0 in 1.253s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.288s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09552ed5-2366-4038-a9f6-b44ec81438b8', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:55:22 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-3251c721-1dbb-44f4-bf77-a8502c0e82de req-94d39a60-62a6-46f9-acfc-109bb3862bd7 tempest-TestInstancesWithCinderVolumes-302546399 None] attachment_update completed successfully.
Jun 29 04:55:23 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.979s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:23 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:55:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a15038eb-37f4-42bb-8dea-c711ea82a30e tempest-VolumesGetTest-1231824455 None] Lock "cinder-e4f7b320-85e8-47d7-8d3e-bff204a0fda8-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (645960b0-2ca8-42fa-8ef6-0a80c11c37e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891282e-6e53-4ae1-a2f0-b9b10d4ab705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891282e-6e53-4ae1-a2f0-b9b10d4ab705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-606189594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56eca1cc-f99e-4df0-bfac-4109411b98ef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:24Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1814151b-1d38-4fcc-a911-7bf63bb7eaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1814151b-1d38-4fcc-a911-7bf63bb7eaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337674d1-c190-47dc-894e-62d4cdd136de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337674d1-c190-47dc-894e-62d4cdd136de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56eca1cc-f99e-4df0-bfac-4109411b98ef', 'volume_name': 'volume-56eca1cc-f99e-4df0-bfac-4109411b98ef', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872ec1550>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb71778-c938-4880-b4bd-a19cd75c3450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb71778-c938-4880-b4bd-a19cd75c3450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b2c0dc-ec04-4f17-8293-49badc52e37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Volume 56eca1cc-f99e-4df0-bfac-4109411b98ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56eca1cc-f99e-4df0-bfac-4109411b98ef', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872ec1550>}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Trying to clone 56eca1cc-f99e-4df0-bfac-4109411b98ef from image 715ee343-4947-44c8-82ac-b52ccc04493d at location (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 04:55:24 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 04:55:24 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Image download 20.69 MB at 20.69 MB/s
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5cd7d-da96-471e-9863-cef2857a698f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:25 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD
Jun 29 04:55:25 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Flow 'volume_create_manager' (86e6d96d-e332-4404-8292-f4684827e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0017ce-3c8e-4f19-b0ed-c30da87e3170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0017ce-3c8e-4f19-b0ed-c30da87e3170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1713432348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e53464a-dbcf-49c1-9f80-7275bd429432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e11b8f507c141fc91b07158fcfe9874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:25Z,use_quota=True,user_id='34fec302c94442c7b7c4774802c822b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a805943-333d-431f-8064-6b9e94a8dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a805943-333d-431f-8064-6b9e94a8dc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a90784-6a42-494b-97ab-7ccf8226ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a90784-6a42-494b-97ab-7ccf8226ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e53464a-dbcf-49c1-9f80-7275bd429432', 'volume_name': 'volume-8e53464a-dbcf-49c1-9f80-7275bd429432', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1afd72b-1a96-41b8-9e98-430d3b659ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1afd72b-1a96-41b8-9e98-430d3b659ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146ed206-fe5c-4f85-92db-ed4fcae58432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:25 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Volume 8e53464a-dbcf-49c1-9f80-7275bd429432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e53464a-dbcf-49c1-9f80-7275bd429432', 'volume_size': 1}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1713432348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e53464a-dbcf-49c1-9f80-7275bd429432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e11b8f507c141fc91b07158fcfe9874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:25Z,use_quota=True,user_id='34fec302c94442c7b7c4774802c822b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Creating volume 8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:25 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:25 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 1073741824
Jun 29 04:55:25 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:25 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d is fetched for user 15592edb9522423fb29bb9e35309a66f. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48180a2-d1b3-46bf-baa9-11dfb887f940]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:26 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD
Jun 29 04:55:26 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:26 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 1073741824" returned: 0 in 1.055s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:26 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:55:26 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:26 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (cddd61aa-f494-4c29-b8e4-2bedc7dd5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf8705-7a90-4618-91a2-82afe2a934c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf8705-7a90-4618-91a2-82afe2a934c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9097206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b7016-1ddd-409c-bca5-5c957285bedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:27Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b51c901-05d2-401a-bccc-6d9c55d3f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b51c901-05d2-401a-bccc-6d9c55d3f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befbe55c-1b8e-49e9-a1a3-4aa9594f14b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befbe55c-1b8e-49e9-a1a3-4aa9594f14b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524b7016-1ddd-409c-bca5-5c957285bedd', 'volume_name': 'volume-524b7016-1ddd-409c-bca5-5c957285bedd', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e6bdf6-8aaa-424a-94c7-4442f1c948f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e6bdf6-8aaa-424a-94c7-4442f1c948f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd40fb7-cbc8-4947-9bcf-b9a7f344b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Volume 524b7016-1ddd-409c-bca5-5c957285bedd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524b7016-1ddd-409c-bca5-5c957285bedd', 'volume_size': 1}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:27 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 0.824s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-606189594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56eca1cc-f99e-4df0-bfac-4109411b98ef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:24Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Creating volume 56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:27 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:27 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1073741824
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146ed206-fe5c-4f85-92db-ed4fcae58432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e53464a-dbcf-49c1-9f80-7275bd429432', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535e8eef-10d8-44c6-8036-835e3b4fc4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:27 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Volume volume-8e53464a-dbcf-49c1-9f80-7275bd429432 (8e53464a-dbcf-49c1-9f80-7275bd429432): created successfully
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535e8eef-10d8-44c6-8036-835e3b4fc4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Flow 'volume_create_manager' (86e6d96d-e332-4404-8292-f4684827e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:27 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b250d421-7f1f-4238-b0f5-c7b154ef18bf tempest-TestStampPattern-1842297936 None] Created volume successfully.
Jun 29 04:55:28 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1073741824" returned: 0 in 0.911s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:28 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:28 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:29 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 0 in 0.691s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-9097206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b7016-1ddd-409c-bca5-5c957285bedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:27Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Creating volume 524b7016-1ddd-409c-bca5-5c957285bedd {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:29 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:29 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd 1073741824
Jun 29 04:55:29 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Attempting download of 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume 56eca1cc-f99e-4df0-bfac-4109411b98ef. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eafd9f-4320-4d6e-86c1-aec73777852f]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:29 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6
Jun 29 04:55:29 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:30 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6" returned: 0 in 0.829s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:30 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd 1073741824" returned: 0 in 0.973s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:30 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd
Jun 29 04:55:30 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:30 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6
Jun 29 04:55:30 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:30 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd" returned: 0 in 0.707s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:30 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6" returned: 1 in 0.781s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_5rtxqpe6' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d8536-f840-4e6b-962b-5067653d4f44]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd40fb7-cbc8-4947-9bcf-b9a7f344b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524b7016-1ddd-409c-bca5-5c957285bedd', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775cbad3-668c-426b-a0af-cb7d8a2a2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:30 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Volume volume-524b7016-1ddd-409c-bca5-5c957285bedd (524b7016-1ddd-409c-bca5-5c957285bedd): created successfully
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775cbad3-668c-426b-a0af-cb7d8a2a2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (cddd61aa-f494-4c29-b8e4-2bedc7dd5bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8bd9d7fe-7c9b-48f7-a99e-68efb58477c2 tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:55:31 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD
Jun 29 04:55:31 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-524b7016-1ddd-409c-bca5-5c957285bedd-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-524b7016-1ddd-409c-bca5-5c957285bedd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-quobyte-524b7016-1ddd-409c-bca5-5c957285bedd" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-524b7016-1ddd-409c-bca5-5c957285bedd" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5b1e5-d7e2-471c-8a51-c7df98600818]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:31 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd
Jun 29 04:55:31 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:31 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] 715ee343-4947-44c8-82ac-b52ccc04493d was qcow2, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 04:55:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:31 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:31 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:32 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-de6b0f42-d146-4ea9-84e4-4f27aa3d3870 req-bdc7942f-be09-42da-963f-37529d359dd8 tempest-TestInstancesWithCinderVolumes-302546399 None] Terminate volume connection completed successfully.
Jun 29 04:55:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-de6b0f42-d146-4ea9-84e4-4f27aa3d3870 req-bdc7942f-be09-42da-963f-37529d359dd8 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleting attachment 2d5acc9b-20c1-4f39-af80-fb39637bbd0f. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:55:32 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd" returned: 0 in 1.122s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:32 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd
Jun 29 04:55:32 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:33 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-524b7016-1ddd-409c-bca5-5c957285bedd" returned: 0 in 0.848s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-524b7016-1ddd-409c-bca5-5c957285bedd" released by "delete_volume" :: held 2.034s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Created reservations ['dffc3a7c-9022-4f5c-83c9-1bf7df01b72a', '6f438572-9a64-4c53-b2d6-e494c1c47de0', '71340300-704a-43ea-b93e-d7626785e60a', '047807cc-fa7a-44f4-b7e8-d4d6117c8cbf'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:33 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:33 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-1dabb62e-3ba6-45c1-b66f-626775b80c47-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-1dabb62e-3ba6-45c1-b66f-626775b80c47-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-quobyte-1dabb62e-3ba6-45c1-b66f-626775b80c47" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-1dabb62e-3ba6-45c1-b66f-626775b80c47" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a91e1-2436-48be-9b3f-64856d875101]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:34 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47
Jun 29 04:55:34 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:34 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 0 in 2.770s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d_uzmb39tydevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:55:34 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Converted 112.00 MB image at 40.42 MB/s
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:34 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1G
Jun 29 04:55:34 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:34 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Deleted volume successfully.
Jun 29 04:55:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e044b8ed-403e-4645-90fe-9c8f5599c1e3 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-524b7016-1ddd-409c-bca5-5c957285bedd-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:35 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef 1G" returned: 0 in 0.958s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:35 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47" returned: 0 in 1.209s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739bb7d-0c99-45eb-a5eb-1707da9a7302]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:35 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47
Jun 29 04:55:35 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (e09a8ce9-0298-4808-a843-ead1664a0ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edabd5ff-956e-4b03-a9d7-ff1bdbad6f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edabd5ff-956e-4b03-a9d7-ff1bdbad6f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363074289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce61d36a-6791-46f1-940d-3d579360dd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:36Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5650cce-2b05-425d-bdb0-16092eda9935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:35 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:35 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5650cce-2b05-425d-bdb0-16092eda9935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722263a-b1e8-4ef5-8b42-c134b0999bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722263a-b1e8-4ef5-8b42-c134b0999bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce61d36a-6791-46f1-940d-3d579360dd1b', 'volume_name': 'volume-ce61d36a-6791-46f1-940d-3d579360dd1b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01eef5c-8133-45db-aaad-1f9d22899d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01eef5c-8133-45db-aaad-1f9d22899d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac1928a-357d-4258-9e35-2d1bf55925b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:35 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Volume ce61d36a-6791-46f1-940d-3d579360dd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce61d36a-6791-46f1-940d-3d579360dd1b', 'volume_size': 1}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363074289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce61d36a-6791-46f1-940d-3d579360dd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:36Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Creating volume ce61d36a-6791-46f1-940d-3d579360dd1b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:35 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:35 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b 1073741824
Jun 29 04:55:35 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:36 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1dabb62e-3ba6-45c1-b66f-626775b80c47" returned: 0 in 0.848s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-1dabb62e-3ba6-45c1-b66f-626775b80c47" released by "delete_volume" :: held 2.131s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:36 devstack cinder-volume[93723]: WARNING cinder.quota [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-117431204-1054113276 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-117431204-1054113276, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:36 devstack cinder-volume[93723]: WARNING cinder.quota [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-117431204-1054113276 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-117431204-1054113276, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Created reservations ['3310ab89-3885-4e81-8ef9-845f28a177e9', 'b18a288d-8fa7-43aa-b87c-aeb50612861e', 'a7ad8e31-c067-438a-84aa-f2a1684839d3', 'ce7964cf-e7b9-459c-9b31-07eaf77b7b22'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:36 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:36 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:36 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 0 in 1.164s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:36 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:36 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:36 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b 1073741824" returned: 0 in 1.134s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:37 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b
Jun 29 04:55:37 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:37 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleted volume successfully.
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8198c1ed-ddd3-493d-979c-7b6ac07cf2a3 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-1dabb62e-3ba6-45c1-b66f-626775b80c47-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:37 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 1 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Downloaded image 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume 56eca1cc-f99e-4df0-bfac-4109411b98ef successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d for user 15592edb9522423fb29bb9e35309a66f is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Marking volume 56eca1cc-f99e-4df0-bfac-4109411b98ef as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Copying metadata from image 715ee343-4947-44c8-82ac-b52ccc04493d to 56eca1cc-f99e-4df0-bfac-4109411b98ef. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Creating volume glance metadata for volume 56eca1cc-f99e-4df0-bfac-4109411b98ef backed by image 715ee343-4947-44c8-82ac-b52ccc04493d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b2c0dc-ec04-4f17-8293-49badc52e37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56eca1cc-f99e-4df0-bfac-4109411b98ef', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872ec1550>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c56389-5b03-49dc-9e3c-b4685a45f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Volume volume-56eca1cc-f99e-4df0-bfac-4109411b98ef (56eca1cc-f99e-4df0-bfac-4109411b98ef): created successfully
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c56389-5b03-49dc-9e3c-b4685a45f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (645960b0-2ca8-42fa-8ef6-0a80c11c37e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d977655b-354a-4590-8064-66c361e79c4b tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:55:37 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b" returned: 0 in 0.862s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac1928a-357d-4258-9e35-2d1bf55925b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce61d36a-6791-46f1-940d-3d579360dd1b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fc04fb-0638-4eee-baf7-f669816f85b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Volume volume-ce61d36a-6791-46f1-940d-3d579360dd1b (ce61d36a-6791-46f1-940d-3d579360dd1b): created successfully
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fc04fb-0638-4eee-baf7-f669816f85b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (e09a8ce9-0298-4808-a843-ead1664a0ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2d4df7be-141e-408c-80ff-0b4697bd1cf7 tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:55:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-ce61d36a-6791-46f1-940d-3d579360dd1b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-ce61d36a-6791-46f1-940d-3d579360dd1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-quobyte-ce61d36a-6791-46f1-940d-3d579360dd1b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (90150c28-15a9-41f8-a127-a22fdc30eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b415c8b-1180-40d5-93f9-cec67fa3ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b415c8b-1180-40d5-93f9-cec67fa3ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949045221',display_name='tempest-VolumesGetTest-Volume-1125690311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35943052-23da-4f3a-adea-c7b924ab149b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:39Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc635198-22ab-4a86-bfca-c005d0917953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc635198-22ab-4a86-bfca-c005d0917953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274bc600-ee29-4f18-b8c8-f579ea838f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274bc600-ee29-4f18-b8c8-f579ea838f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35943052-23da-4f3a-adea-c7b924ab149b', 'volume_name': 'volume-35943052-23da-4f3a-adea-c7b924ab149b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d68d8a-28fb-4c29-a57f-ea8174523899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d68d8a-28fb-4c29-a57f-ea8174523899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d12842-d0cb-46b9-843b-11ae06dfe444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Volume 35943052-23da-4f3a-adea-c7b924ab149b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35943052-23da-4f3a-adea-c7b924ab149b', 'volume_size': 1}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949045221',display_name='tempest-VolumesGetTest-Volume-1125690311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35943052-23da-4f3a-adea-c7b924ab149b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4606e27d9643b98f5f026126609526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:39Z,use_quota=True,user_id='15592edb9522423fb29bb9e35309a66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Creating volume 35943052-23da-4f3a-adea-c7b924ab149b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:39 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-ce61d36a-6791-46f1-940d-3d579360dd1b" acquired by "delete_volume" :: waited 0.171s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:39 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b 1073741824
Jun 29 04:55:39 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c8fbd-4b9f-4b97-8e39-21e5142a950a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:39 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b
Jun 29 04:55:39 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:39 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-b3ae0cd7-d5dd-4174-aa52-418c9e8331aa req-d2c385b0-3c10-4108-8a3a-7e7dbd68d903 tempest-TestInstancesWithCinderVolumes-302546399 None] Terminate volume connection completed successfully.
Jun 29 04:55:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-b3ae0cd7-d5dd-4174-aa52-418c9e8331aa req-d2c385b0-3c10-4108-8a3a-7e7dbd68d903 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleting attachment 09552ed5-2366-4038-a9f6-b44ec81438b8. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:55:40 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b" returned: 0 in 1.304s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:40 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b
Jun 29 04:55:40 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:40 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b 1073741824" returned: 0 in 1.436s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:40 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b
Jun 29 04:55:40 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:41 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ce61d36a-6791-46f1-940d-3d579360dd1b" returned: 0 in 0.837s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-ce61d36a-6791-46f1-940d-3d579360dd1b" released by "delete_volume" :: held 2.214s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:41 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b" returned: 0 in 0.779s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Created reservations ['14cc180b-2fe2-44a4-9e0f-28429b9bd19d', '883ece27-3f03-4f51-add3-0768f101e572', 'a8ac8428-e31e-4457-8ce6-80cf7af19505', '5ac33846-9169-4d27-bb77-32808bbf83bb'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d12842-d0cb-46b9-843b-11ae06dfe444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35943052-23da-4f3a-adea-c7b924ab149b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbee1619-5b97-482c-8d1d-3231e49f5ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-d9e73756-a2ec-40f7-b1df-251ee40a5d75-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Volume volume-35943052-23da-4f3a-adea-c7b924ab149b (35943052-23da-4f3a-adea-c7b924ab149b): created successfully
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbee1619-5b97-482c-8d1d-3231e49f5ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Flow 'volume_create_manager' (90150c28-15a9-41f8-a127-a22fdc30eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-d9e73756-a2ec-40f7-b1df-251ee40a5d75-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-cbaf8c60-eee6-4a53-8085-be5d6da0beef tempest-VolumesGetTest-1231824455 None] Created volume successfully.
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-quobyte-d9e73756-a2ec-40f7-b1df-251ee40a5d75" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-d9e73756-a2ec-40f7-b1df-251ee40a5d75" acquired by "delete_volume" :: waited 0.046s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:41 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:41 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb90022-f3a9-480b-8dae-bf3c5315babc]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:41 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75
Jun 29 04:55:41 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-35943052-23da-4f3a-adea-c7b924ab149b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:42 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.219s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:42 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-35943052-23da-4f3a-adea-c7b924ab149b-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:42 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Deleted volume successfully.
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b42678d-320b-4bc0-8569-c5f876a97ed1 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-ce61d36a-6791-46f1-940d-3d579360dd1b-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-35943052-23da-4f3a-adea-c7b924ab149b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-35943052-23da-4f3a-adea-c7b924ab149b" acquired by "delete_volume" :: waited 0.039s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c8e6a-ce3f-4936-bf9d-c2b66b66e918]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:43 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75" returned: 0 in 1.517s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:43 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75
Jun 29 04:55:43 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:43 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b
Jun 29 04:55:43 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (747befdb-b1b3-472c-a8e3-935827bf15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c7339-3f05-46d0-8e3c-591b7b39a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c7339-3f05-46d0-8e3c-591b7b39a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819576532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eccb78-fcc9-4011-900c-8ddaa4867dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:44Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7012a4c5-6666-4a4d-b0f1-062824358fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7012a4c5-6666-4a4d-b0f1-062824358fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ab8a40-5127-4443-b843-801281fed486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ab8a40-5127-4443-b843-801281fed486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6eccb78-fcc9-4011-900c-8ddaa4867dd8', 'volume_name': 'volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa4a9e2-014d-4064-9b56-09e2d932aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa4a9e2-014d-4064-9b56-09e2d932aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44e11c-04a2-415b-86db-7c81e0a922dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:43 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Volume d6eccb78-fcc9-4011-900c-8ddaa4867dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8', 'volume_size': 1}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819576532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eccb78-fcc9-4011-900c-8ddaa4867dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:44Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Creating volume d6eccb78-fcc9-4011-900c-8ddaa4867dd8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:43 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:43 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 1073741824
Jun 29 04:55:43 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:44 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d9e73756-a2ec-40f7-b1df-251ee40a5d75" returned: 0 in 1.319s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-d9e73756-a2ec-40f7-b1df-251ee40a5d75" released by "delete_volume" :: held 2.903s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=110,cinder:DELETE=3,cinder:SELECT=79,cinder:INSERT=38 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:55:44 devstack cinder-volume[93723]: WARNING cinder.quota [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-213523694-1125884975 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-213523694-1125884975, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:44 devstack cinder-volume[93723]: WARNING cinder.quota [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-213523694-1125884975 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-213523694-1125884975, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Created reservations ['a51bd17d-08d3-4e62-ad9a-7c4111f4cf69', '19d89524-31af-405c-9c1b-edd896dacca2', 'a55d10ea-8abd-43c6-ba6e-d510eedc72d4', 'ec244d0a-cec6-4df7-94e1-cd76e809bdbf'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:44 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b" returned: 0 in 1.722s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:44 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b
Jun 29 04:55:44 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:45 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:45 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:45 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 1073741824" returned: 0 in 1.760s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:45 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-35943052-23da-4f3a-adea-c7b924ab149b" returned: 0 in 0.878s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-35943052-23da-4f3a-adea-c7b924ab149b" released by "delete_volume" :: held 2.677s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:45 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8
Jun 29 04:55:45 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Created reservations ['471f443d-3d87-4315-b71e-bcb1e5cdc80d', 'acafe0c0-5537-456a-b21d-d07fa45eb49e', 'e8e1158d-aba0-461b-be73-c43842ce2454', 'cd616c60-55c0-4825-bcef-93998ea0f502'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:46 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:46 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:46 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.251s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleted volume successfully.
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-835eedda-efc3-4d4c-953c-bbd9aa3c9f11 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-d9e73756-a2ec-40f7-b1df-251ee40a5d75-delete_volume" released by "delete_volume" :: held 4.855s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-56eca1cc-f99e-4df0-bfac-4109411b98ef-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-56eca1cc-f99e-4df0-bfac-4109411b98ef-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "cinder-quobyte-56eca1cc-f99e-4df0-bfac-4109411b98ef" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-56eca1cc-f99e-4df0-bfac-4109411b98ef" acquired by "delete_volume" :: waited 0.042s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ca839d-dbe5-46c5-8e08-58530888f796]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:47 devstack sudo[106282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:47 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:47 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" returned: 0 in 1.656s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (3535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.544s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44e11c-04a2-415b-86db-7c81e0a922dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d223720-027e-4a76-a89a-05d5eaa4b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Volume volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 (d6eccb78-fcc9-4011-900c-8ddaa4867dd8): created successfully
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d223720-027e-4a76-a89a-05d5eaa4b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (747befdb-b1b3-472c-a8e3-935827bf15af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-799c1aee-636f-47c4-860d-51c317e62313 tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:55:47 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.682s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:55:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04dd2e6-5054-4770-9fb2-cfb28bbb58b8 tempest-VolumesGetTest-1231824455 None] Lock "cinder-35943052-23da-4f3a-adea-c7b924ab149b-delete_volume" released by "delete_volume" :: held 4.881s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:48 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 0 in 1.147s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:48 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:48 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-d6eccb78-fcc9-4011-900c-8ddaa4867dd8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-d6eccb78-fcc9-4011-900c-8ddaa4867dd8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-quobyte-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" acquired by "delete_volume" :: waited 0.042s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[53306f47-accb-4f97-a8c0-8edc2bf3c077]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:49 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8
Jun 29 04:55:49 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:49 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 1 in 1.647s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:55:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:49 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef
Jun 29 04:55:49 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:50 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" returned: 0 in 1.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:50 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8
Jun 29 04:55:50 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:51 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-56eca1cc-f99e-4df0-bfac-4109411b98ef" returned: 0 in 1.486s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-quobyte-56eca1cc-f99e-4df0-bfac-4109411b98ef" released by "delete_volume" :: held 4.415s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Created reservations ['24ce3e16-65b9-41d5-a9ea-6efdbb9fb917', '8d688d84-f581-4c8e-9c88-4ed03958ec73', '7a674c97-3bcc-4758-bf4a-e536f0491982', '52d615a7-a5f2-4716-a898-0ad8d36f36d2'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:51 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:51 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:51 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" returned: 0 in 1.108s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-d6eccb78-fcc9-4011-900c-8ddaa4867dd8" released by "delete_volume" :: held 2.898s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Created reservations ['68cdf8b2-0b3d-4cfa-9068-fb4671db8f64', 'f9a5fa51-ab88-4d2d-8561-9e65942f7e27', 'b56751fd-b7ea-4e81-8b9b-d7d687301172', 'e6746bd7-a63b-4cb4-b095-878d2080a24b'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:51 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:51 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-af993308-5bdd-45a6-a3d5-2dc80b29d768 req-ffc5e857-3477-4030-af5c-13a4c26c1e48 tempest-TestInstancesWithCinderVolumes-302546399 None] Terminate volume connection completed successfully.
Jun 29 04:55:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-af993308-5bdd-45a6-a3d5-2dc80b29d768 req-ffc5e857-3477-4030-af5c-13a4c26c1e48 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleting attachment c2ef6ede-955a-4f94-8084-f85419f508f8. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:55:52 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:52 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Deleted volume successfully.
Jun 29 04:55:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a1a2903e-bedf-42f9-a4f9-6a7ecee26a87 tempest-VolumesGetTest-1231824455 None] Lock "cinder-56eca1cc-f99e-4df0-bfac-4109411b98ef-delete_volume" released by "delete_volume" :: held 5.785s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:53 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (472e0cb5-9ddd-4aa5-b912-dbea17742b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ca826a-ded9-4838-8c0b-2bc703e4d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.277s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Deleted volume successfully.
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ca826a-ded9-4838-8c0b-2bc703e4d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874518656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5039c-641d-48e1-86b8-ca7a5761d809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:53Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427ff0c6-e9e2-4f91-8052-7c1edb63f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427ff0c6-e9e2-4f91-8052-7c1edb63f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856aa234-8bda-42e0-9a85-19baafaca117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856aa234-8bda-42e0-9a85-19baafaca117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f5039c-641d-48e1-86b8-ca7a5761d809', 'volume_name': 'volume-74f5039c-641d-48e1-86b8-ca7a5761d809', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe40f1-be90-41d0-89b4-e3858c0fc45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fe40f1-be90-41d0-89b4-e3858c0fc45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e50c00-701d-4c82-a10f-761935dee85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:53 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Volume 74f5039c-641d-48e1-86b8-ca7a5761d809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f5039c-641d-48e1-86b8-ca7a5761d809', 'volume_size': 1}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874518656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5039c-641d-48e1-86b8-ca7a5761d809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:53Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Creating volume 74f5039c-641d-48e1-86b8-ca7a5761d809 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:53 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41d22d85-1109-45fc-8dae-827761241831 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-d6eccb78-fcc9-4011-900c-8ddaa4867dd8-delete_volume" released by "delete_volume" :: held 4.606s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:53 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 1073741824
Jun 29 04:55:53 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:54 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 1073741824" returned: 0 in 1.030s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:54 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809
Jun 29 04:55:54 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:54 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809" returned: 0 in 0.669s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:55:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e50c00-701d-4c82-a10f-761935dee85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f5039c-641d-48e1-86b8-ca7a5761d809', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d899d6f-3e8d-45e7-ab8e-129071fbe0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Volume volume-74f5039c-641d-48e1-86b8-ca7a5761d809 (74f5039c-641d-48e1-86b8-ca7a5761d809): created successfully
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d899d6f-3e8d-45e7-ab8e-129071fbe0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (472e0cb5-9ddd-4aa5-b912-dbea17742b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f7f20547-fa98-4874-963e-15a406b17d2a tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-6ab19944-240b-4bb5-bc77-b3b982ef39d1-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-6ab19944-240b-4bb5-bc77-b3b982ef39d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "cinder-quobyte-6ab19944-240b-4bb5-bc77-b3b982ef39d1" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-6ab19944-240b-4bb5-bc77-b3b982ef39d1" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fed3782-fd5b-4965-9a7b-8b649597da08]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:56 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:55:56 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-74f5039c-641d-48e1-86b8-ca7a5761d809-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-74f5039c-641d-48e1-86b8-ca7a5761d809-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "cinder-quobyte-74f5039c-641d-48e1-86b8-ca7a5761d809" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-74f5039c-641d-48e1-86b8-ca7a5761d809" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ae2006-4b69-49f2-b381-048465fb76be]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:56 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809
Jun 29 04:55:56 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:56 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 0.890s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:56 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:55:56 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:57 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:57 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809
Jun 29 04:55:57 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:57 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 1 in 0.840s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:55:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:57 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1
Jun 29 04:55:57 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:58 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-74f5039c-641d-48e1-86b8-ca7a5761d809" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-quobyte-74f5039c-641d-48e1-86b8-ca7a5761d809" released by "delete_volume" :: held 1.631s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Created reservations ['b0c4f247-1ba0-435b-9b62-2c7f82301e58', 'bfb6ff7a-1a8a-468e-9dc2-63bc17b42e4e', 'cf43b95e-6011-48d4-8600-1bff1c90c7be', 'e46282b7-8c07-46a7-beb8-a66cac9c26ce'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:58 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:58 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:58 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6ab19944-240b-4bb5-bc77-b3b982ef39d1" returned: 0 in 0.721s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-quobyte-6ab19944-240b-4bb5-bc77-b3b982ef39d1" released by "delete_volume" :: held 2.528s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:58 devstack cinder-volume[93723]: WARNING cinder.quota [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98118880-2121929703 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98118880-2121929703, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:58 devstack cinder-volume[93723]: WARNING cinder.quota [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98118880-2121929703 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-98118880-2121929703, it is now deprecated. Please use the default quota class for default quota.
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Created reservations ['b4602e30-6392-4255-bfe1-25c9449d2fdd', '6a66cc95-ad12-47c0-bbf9-c50e82d26e94', '902829c1-4321-4a81-95b9-ac31a43dd0b9', '9793f66b-9749-4fb2-816a-b310056c2903'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:58 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:55:58 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:58 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.687s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Deleted volume successfully.
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5fc10546-1c83-4b68-9f3a-97bf4e78c759 tempest-VolumesActionsTest-1972814227 None] Lock "cinder-74f5039c-641d-48e1-86b8-ca7a5761d809-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (79b8bf9c-c56b-4499-9120-125ecec8b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07e03a-06f1-4922-bd24-52ae5b8eb1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07e03a-06f1-4922-bd24-52ae5b8eb1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649420209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e907c973-6d4a-4ca2-8a96-4e60c3eefa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:59Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1590a2eb-64e6-4d85-acc0-92793e23d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1590a2eb-64e6-4d85-acc0-92793e23d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad9b54-47bc-4eeb-884a-2de31060a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad9b54-47bc-4eeb-884a-2de31060a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e907c973-6d4a-4ca2-8a96-4e60c3eefa9a', 'volume_name': 'volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c38089-0642-489d-971e-e859ae7433e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c38089-0642-489d-971e-e859ae7433e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a853e2f-6758-44d6-99d9-645838c05247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:55:59 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Volume e907c973-6d4a-4ca2-8a96-4e60c3eefa9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a', 'volume_size': 1}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649420209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e907c973-6d4a-4ca2-8a96-4e60c3eefa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4e74f1b784242b8076914a49fc9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:55:59Z,use_quota=True,user_id='a4bf93ca347141969f1f8a9c22ec7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Creating volume e907c973-6d4a-4ca2-8a96-4e60c3eefa9a {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:55:59 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:55:59 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.935s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:55:59 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a 1073741824
Jun 29 04:55:59 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:55:59 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Deleted volume successfully.
Jun 29 04:55:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b47b2c99-d891-47af-879b-fa72ecae8148 tempest-TestInstancesWithCinderVolumes-302546399 None] Lock "cinder-6ab19944-240b-4bb5-bc77-b3b982ef39d1-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:00 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a 1073741824" returned: 0 in 1.051s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:00 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a
Jun 29 04:56:00 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:01 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" returned: 0 in 1.081s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a853e2f-6758-44d6-99d9-645838c05247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6060e8-f593-405b-b85d-9186318a59d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Volume volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a (e907c973-6d4a-4ca2-8a96-4e60c3eefa9a): created successfully
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6060e8-f593-405b-b85d-9186318a59d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Flow 'volume_create_manager' (79b8bf9c-c56b-4499-9120-125ecec8b71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d86d9ec6-2e01-4e22-a79e-148c8492e244 tempest-VolumesActionsTest-1714921824 None] Created volume successfully.
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "cinder-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Acquiring lock "cinder-quobyte-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "cinder-quobyte-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[063529d7-430c-48ef-9422-7c2e51e2d3a4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:03 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:56:03 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:03 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a
Jun 29 04:56:03 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:04 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" returned: 0 in 1.237s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:04 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.249s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:56:04 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a
Jun 29 04:56:04 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:56:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:56:05 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" returned: 0 in 1.067s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "cinder-quobyte-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a" released by "delete_volume" :: held 2.364s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:05 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Created reservations ['bc49c7c4-d930-4023-9659-3ea15bd1d78d', '2a1c6b4b-9599-4008-b0ba-44ff326b0f42', 'fefe3573-779b-4236-8183-0a618aacf725', '6d5955d5-ead0-4176-9a97-6705da815cdc'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:56:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b330802-517e-44b3-a73a-5670c5db3334]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:06 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:56:06 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:06 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:56:06 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:07 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:56:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Deleted volume successfully.
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fde83c5f-83c5-4adc-b28f-4ddbf8abe54f tempest-VolumesActionsTest-1714921824 None] Lock "cinder-e907c973-6d4a-4ca2-8a96-4e60c3eefa9a-delete_volume" released by "delete_volume" :: held 3.794s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:07 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.055s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=146,cinder:SELECT=129,cinder:DELETE=17,cinder:INSERT=34 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:56:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-8e53464a-dbcf-49c1-9f80-7275bd429432', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b83a9d1-728a-4e2b-99b7-766a247c3b7a', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:56:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-d0d9805d-fe6b-4730-93a7-f01b2d4a6647 req-76196831-822a-4f6c-bba8-ea324302b69e tempest-TestStampPattern-1842297936 None] attachment_update completed successfully.
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (8939a8f0-87ee-410f-ac0c-e478a912eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201cbd79-1a48-4c10-93fb-dd719e577b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201cbd79-1a48-4c10-93fb-dd719e577b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1585563502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662d2a61-ced2-4180-a76b-9aef9289bf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:10Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee457e2-5989-4484-b85b-5f7f39b1cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee457e2-5989-4484-b85b-5f7f39b1cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a4d4e3-0262-4e92-989e-ca0c2929cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a4d4e3-0262-4e92-989e-ca0c2929cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662d2a61-ced2-4180-a76b-9aef9289bf88', 'volume_name': 'volume-662d2a61-ced2-4180-a76b-9aef9289bf88', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b236f1-18af-439a-9429-92285809a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b236f1-18af-439a-9429-92285809a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc0270-5756-408c-b886-37e7f1d6e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:09 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Volume 662d2a61-ced2-4180-a76b-9aef9289bf88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662d2a61-ced2-4180-a76b-9aef9289bf88', 'volume_size': 1}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1585563502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662d2a61-ced2-4180-a76b-9aef9289bf88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:10Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Creating volume 662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:56:09 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:56:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:09 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 1073741824
Jun 29 04:56:09 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:10 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 1073741824" returned: 0 in 1.067s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:10 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88
Jun 29 04:56:10 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:11 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88" returned: 0 in 0.948s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc0270-5756-408c-b886-37e7f1d6e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662d2a61-ced2-4180-a76b-9aef9289bf88', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb12054-1b17-487d-80ef-d832ef09a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:11 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Volume volume-662d2a61-ced2-4180-a76b-9aef9289bf88 (662d2a61-ced2-4180-a76b-9aef9289bf88): created successfully
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb12054-1b17-487d-80ef-d832ef09a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (8939a8f0-87ee-410f-ac0c-e478a912eede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0f72092b-f114-4c16-9286-e8cd6e47f930 tempest-VolumesSnapshotTestJSON-99631389 None] Created volume successfully.
Jun 29 04:56:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Creating offline snapshot 8bbfbae7-4f3e-446b-84c5-b8ed6776c980 of volume 662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:56:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405cfff-7ecc-4ca0-93af-3a151b03ee74]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:13 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88
Jun 29 04:56:13 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:14 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:14 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 1G
Jun 29 04:56:14 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:15 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 1G" returned: 0 in 1.137s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662d2a61-ced2-4180-a76b-9aef9289bf88 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:15 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662d2a61-ced2-4180-a76b-9aef9289bf88 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980
Jun 29 04:56:15 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:16 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662d2a61-ced2-4180-a76b-9aef9289bf88 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980" returned: 0 in 0.965s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:16 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 is being set with open permissions: ugo+rw
Jun 29 04:56:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:16 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980
Jun 29 04:56:16 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-63f84917-441d-47d3-a5d1-3e6b4522ed61 req-cc39aae4-56dc-421e-ac3c-dcfc9f2369c0 tempest-TestStampPattern-1842297936 None] Terminate volume connection completed successfully.
Jun 29 04:56:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-63f84917-441d-47d3-a5d1-3e6b4522ed61 req-cc39aae4-56dc-421e-ac3c-dcfc9f2369c0 tempest-TestStampPattern-1842297936 None] Deleting attachment 3b83a9d1-728a-4e2b-99b7-766a247c3b7a. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:56:17 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980" returned: 0 in 0.955s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:17 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info
Jun 29 04:56:17 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:18 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info" returned: 0 in 0.791s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:18 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info is being set with open permissions: ugo+rw
Jun 29 04:56:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:18 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info
Jun 29 04:56:18 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:18 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.info" returned: 0 in 0.737s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.648s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:19 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2d0a8e58-bdb8-4d16-95e9-cee845c077af tempest-VolumesSnapshotTestJSON-99631389 None] Create snapshot completed successfully
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Creating offline snapshot 8ae64e79-587f-4788-a99f-e17e758ef9d7 of volume 8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7738774-0b73-4a9a-beb1-256e7e3bf826]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:19 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:56:19 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-8bbfbae7-4f3e-446b-84c5-b8ed6776c980-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-8bbfbae7-4f3e-446b-84c5-b8ed6776c980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-8bbfbae7-4f3e-446b-84c5-b8ed6776c980" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8bbfbae7-4f3e-446b-84c5-b8ed6776c980" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Deleting offline snapshot 8bbfbae7-4f3e-446b-84c5-b8ed6776c980 of volume 662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] snapshot_file for this snap is: volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f70206-c1f5-41b4-b997-bdad7ae160ef]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:20 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980
Jun 29 04:56:20 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:20 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.027s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:20 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 1G
Jun 29 04:56:20 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:20 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980" returned: 0 in 0.868s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662d2a61-ced2-4180-a76b-9aef9289bf88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbaf91f-73e8-4e77-9d5f-737c7f179ac8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:21 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88
Jun 29 04:56:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:21 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 1G" returned: 0 in 0.967s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e53464a-dbcf-49c1-9f80-7275bd429432 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:21 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e53464a-dbcf-49c1-9f80-7275bd429432 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:56:21 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:21 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88" returned: 0 in 0.959s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:22 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980
Jun 29 04:56:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:22 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e53464a-dbcf-49c1-9f80-7275bd429432 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 1.101s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:22 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 is being set with open permissions: ugo+rw
Jun 29 04:56:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:22 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:56:22 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:23 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980" returned: 0 in 1.203s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:23 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980
Jun 29 04:56:23 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:23 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 0.895s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:23 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info
Jun 29 04:56:23 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88.8bbfbae7-4f3e-446b-84c5-b8ed6776c980" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:24 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8bbfbae7-4f3e-446b-84c5-b8ed6776c980" released by "_delete_snapshot" :: held 4.237s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" released by "delete_snapshot" :: held 4.272s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['5de46810-a9e0-4fcc-b05c-2a782a4371e7', '9162a3a2-4372-49c7-aacf-47e0f2987cde', '0175f698-7002-4e6f-ac98-5f8692a3f1da', '5a7a181f-2199-4e53-a3fa-5e42322d7aa9'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Flow 'volume_create_manager' (152c3a77-bf2d-4f1e-9d82-859ab2c5533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a76c05a-fe0a-4ea9-bb55-c8ad1eed428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a76c05a-fe0a-4ea9-bb55-c8ad1eed428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1077651181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e729851-0630-498c-a6d9-83dd93f06bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c522b16b0b4cec9c2ec1165b2066a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:24Z,use_quota=True,user_id='d0eead4f74f840adbd25a5532560c100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d071e7-9527-45c3-bc16-88603d01e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d071e7-9527-45c3-bc16-88603d01e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f4f5c1-bfc1-49bc-b2cf-c92c86062a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f4f5c1-bfc1-49bc-b2cf-c92c86062a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e729851-0630-498c-a6d9-83dd93f06bd8', 'volume_name': 'volume-9e729851-0630-498c-a6d9-83dd93f06bd8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15891e9b-05ca-4875-9d48-df8c58aa3fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15891e9b-05ca-4875-9d48-df8c58aa3fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95797aeb-8ff9-4dd6-b10b-4f21adc49de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Volume 9e729851-0630-498c-a6d9-83dd93f06bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e729851-0630-498c-a6d9-83dd93f06bd8', 'volume_size': 1}
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Delete snapshot completed successfully.
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-64125919-603b-48b2-baa3-f59a0e06522c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-8bbfbae7-4f3e-446b-84c5-b8ed6776c980-delete_snapshot" released by "delete_snapshot" :: held 4.713s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:24 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info" returned: 0 in 1.316s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:24 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info is being set with open permissions: ugo+rw
Jun 29 04:56:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:24 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info
Jun 29 04:56:24 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:25 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.info" returned: 0 in 0.750s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.181s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1077651181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e729851-0630-498c-a6d9-83dd93f06bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c522b16b0b4cec9c2ec1165b2066a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:24Z,use_quota=True,user_id='d0eead4f74f840adbd25a5532560c100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Creating volume 9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:56:25 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:56:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:25 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 1073741824
Jun 29 04:56:25 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-16239606-00d1-4672-95bf-bf5c47949cbe tempest-TestStampPattern-1842297936 None] Create snapshot completed successfully
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (c35be055-4c60-488f-8d4b-f66dd781a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029db09c-f38e-43ac-8f88-188d554d61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029db09c-f38e-43ac-8f88-188d554d61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1999846030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801bca09-4740-492d-a0bc-e1fd24e9440a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:26Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec358a-4d68-4b36-bb65-565b2cf23158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec358a-4d68-4b36-bb65-565b2cf23158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfdf03d-e3cf-4cb4-ab11-57d59eacb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfdf03d-e3cf-4cb4-ab11-57d59eacb58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801bca09-4740-492d-a0bc-e1fd24e9440a', 'volume_name': 'volume-801bca09-4740-492d-a0bc-e1fd24e9440a', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc64d8eb-5cec-4224-8718-ce3b53bf9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc64d8eb-5cec-4224-8718-ce3b53bf9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9330aeb4-5a3d-4a88-9758-5ebab7901eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Volume 801bca09-4740-492d-a0bc-e1fd24e9440a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801bca09-4740-492d-a0bc-e1fd24e9440a', 'volume_size': 1}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:26 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 1073741824" returned: 0 in 1.223s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:26 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8
Jun 29 04:56:26 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:27 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8" returned: 0 in 0.841s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1999846030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801bca09-4740-492d-a0bc-e1fd24e9440a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:26Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Creating volume 801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:56:27 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:27 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a 1073741824
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95797aeb-8ff9-4dd6-b10b-4f21adc49de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e729851-0630-498c-a6d9-83dd93f06bd8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:27 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236a5a20-5569-4491-a440-63e9842f4e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:27 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Volume volume-9e729851-0630-498c-a6d9-83dd93f06bd8 (9e729851-0630-498c-a6d9-83dd93f06bd8): created successfully
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236a5a20-5569-4491-a440-63e9842f4e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Flow 'volume_create_manager' (152c3a77-bf2d-4f1e-9d82-859ab2c5533f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:27 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-75c6db2c-860b-40e5-a29d-e191cb01be31 tempest-SnapshotMetadataTestJSON-1677673227 None] Created volume successfully.
Jun 29 04:56:28 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a 1073741824" returned: 0 in 0.923s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:28 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:56:28 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:29 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 0.771s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9330aeb4-5a3d-4a88-9758-5ebab7901eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801bca09-4740-492d-a0bc-e1fd24e9440a', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e030e2-906d-42bd-9aee-71f03bc670da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Creating offline snapshot 222c9f20-325c-4f0d-b929-d3dc855b5618 of volume 9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:56:29 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Volume volume-801bca09-4740-492d-a0bc-e1fd24e9440a (801bca09-4740-492d-a0bc-e1fd24e9440a): created successfully
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e030e2-906d-42bd-9aee-71f03bc670da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (c35be055-4c60-488f-8d4b-f66dd781a78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a759c-8c86-4d67-9ead-0ba9b1d7ed2b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:29 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8abeeccb-0181-4ea1-8471-5fe17e8cd15e tempest-VolumesSnapshotTestJSON-99631389 None] Created volume successfully.
Jun 29 04:56:29 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8
Jun 29 04:56:29 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:30 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8" returned: 0 in 0.890s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:30 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 1G
Jun 29 04:56:30 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:31 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 1G" returned: 0 in 0.955s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e729851-0630-498c-a6d9-83dd93f06bd8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:31 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e729851-0630-498c-a6d9-83dd93f06bd8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618
Jun 29 04:56:31 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:32 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e729851-0630-498c-a6d9-83dd93f06bd8 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:32 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 is being set with open permissions: ugo+rw
Jun 29 04:56:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:32 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618
Jun 29 04:56:32 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:32 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618" returned: 0 in 0.713s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:33 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info
Jun 29 04:56:33 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:34 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info" returned: 0 in 1.080s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:34 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info is being set with open permissions: ugo+rw
Jun 29 04:56:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:34 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info
Jun 29 04:56:34 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:34 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.info" returned: 0 in 0.852s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.543s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.516s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Creating offline snapshot 96590d62-0706-431f-97f9-70949116d41e of volume 801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:56:35 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8b0e53cf-713e-46a4-8054-48d5dd653036 tempest-SnapshotMetadataTestJSON-1677673227 None] Create snapshot completed successfully
Jun 29 04:56:35 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e330d5-9ee6-4282-886e-b213d46111d4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:35 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:56:35 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:36 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 1.350s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "cinder-222c9f20-325c-4f0d-b929-d3dc855b5618-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:36 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e 1G
Jun 29 04:56:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-222c9f20-325c-4f0d-b929-d3dc855b5618-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" acquired by "delete_snapshot" :: waited 0.083s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "cinder-quobyte-222c9f20-325c-4f0d-b929-d3dc855b5618" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-222c9f20-325c-4f0d-b929-d3dc855b5618" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Deleting offline snapshot 222c9f20-325c-4f0d-b929-d3dc855b5618 of volume 9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] snapshot_file for this snap is: volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168385c-5936-48af-9c8c-237260a724a7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:36 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618
Jun 29 04:56:36 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e 1G" returned: 0 in 1.004s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801bca09-4740-492d-a0bc-e1fd24e9440a -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:37 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801bca09-4740-492d-a0bc-e1fd24e9440a -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:56:37 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:37 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618" returned: 0 in 0.980s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e729851-0630-498c-a6d9-83dd93f06bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc81f6-30ed-4550-8389-ee94a016ad96]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:37 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8
Jun 29 04:56:37 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:38 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801bca09-4740-492d-a0bc-e1fd24e9440a -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 0.889s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:38 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e is being set with open permissions: ugo+rw
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:38 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:56:38 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Flow 'volume_create_manager' (28081509-90bd-453d-854b-f0c49f74784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d0533d-8fda-4050-8116-6ac3badbb984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d0533d-8fda-4050-8116-6ac3badbb984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616075513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31268ae-7ffa-481c-bef0-caeb23ea01ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e11b8f507c141fc91b07158fcfe9874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ae64e79-587f-4788-a99f-e17e758ef9d7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:38Z,use_quota=True,user_id='34fec302c94442c7b7c4774802c822b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a78f52d-92c5-44bc-976c-2897dabf87f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a78f52d-92c5-44bc-976c-2897dabf87f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0387e9-eb72-4c6b-8235-d448286c5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0387e9-eb72-4c6b-8235-d448286c5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c31268ae-7ffa-481c-bef0-caeb23ea01ce', 'volume_name': 'volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce', 'volume_size': 1, 'snapshot_id': '8ae64e79-587f-4788-a99f-e17e758ef9d7'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ffeec-1fdc-4674-81c9-9c26c158a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ffeec-1fdc-4674-81c9-9c26c158a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ce64cb-683a-44e4-aa70-38c7813fcf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Volume c31268ae-7ffa-481c-bef0-caeb23ea01ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce', 'volume_size': 1, 'snapshot_id': '8ae64e79-587f-4788-a99f-e17e758ef9d7'}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:38 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8" returned: 0 in 1.134s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:38 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618
Jun 29 04:56:38 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:39 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 0.850s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:39 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info
Jun 29 04:56:39 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:39 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618" returned: 0 in 1.197s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:40 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618
Jun 29 04:56:40 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:40 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info" returned: 0 in 1.077s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:40 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info is being set with open permissions: ugo+rw
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:40 devstack sudo[107181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info
Jun 29 04:56:40 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:40 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8.222c9f20-325c-4f0d-b929-d3dc855b5618" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-222c9f20-325c-4f0d-b929-d3dc855b5618" released by "_delete_snapshot" :: held 4.203s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" released by "delete_snapshot" :: held 4.238s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Created reservations ['84da1ab1-d855-4b47-9e10-24e8f9a7e2d9', '7c9e85b0-51a7-41c4-8832-f45e920aa5b4', 'c0e6c9a2-42ed-465f-a707-e4a674d4f3f2', '0e389774-4ad0-4582-94b8-bfad73361024'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:56:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Delete snapshot completed successfully.
Jun 29 04:56:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f59139d4-6421-4370-a9d8-ab987598c308 tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-222c9f20-325c-4f0d-b929-d3dc855b5618-delete_snapshot" released by "delete_snapshot" :: held 4.491s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:41 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.info" returned: 0 in 0.820s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.156s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.622s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7-c31268ae-7ffa-481c-bef0-caeb23ea01ce" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7-c31268ae-7ffa-481c-bef0-caeb23ea01ce" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Creating volume c31268ae-7ffa-481c-bef0-caeb23ea01ce from snapshot 8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-57c1d2e2-f9ae-445a-be1a-03f49a912e46 tempest-VolumesSnapshotTestJSON-99631389 None] Create snapshot completed successfully
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] snapshot: 8ae64e79-587f-4788-a99f-e17e758ef9d7, volume: c31268ae-7ffa-481c-bef0-caeb23ea01ce,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[130dc7ce-4b8a-44f5-9dab-f0f70b51cb31]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:41 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:56:41 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "cinder-9e729851-0630-498c-a6d9-83dd93f06bd8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-9e729851-0630-498c-a6d9-83dd93f06bd8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" acquired by "delete_volume" :: waited 0.052s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb36ee33-3177-4b91-a54c-99ca48f18b44]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:42 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 0.972s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e53464a-dbcf-49c1-9f80-7275bd429432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd82747-f459-4928-a17c-fd725859af17]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:42 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8
Jun 29 04:56:42 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:42 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:56:42 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (dc2264d9-a550-4893-9d70-23c2c7b75df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82549d07-1848-42be-8d2c-8ac410d3d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82549d07-1848-42be-8d2c-8ac410d3d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-273575167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad506b5-4a35-4e91-ba3b-56ee4e062862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=96590d62-0706-431f-97f9-70949116d41e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:43Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16070a56-236b-4d45-9d99-9db04f9522c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16070a56-236b-4d45-9d99-9db04f9522c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e8bd8-939e-4dfa-8558-bb16fc436544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e8bd8-939e-4dfa-8558-bb16fc436544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ad506b5-4a35-4e91-ba3b-56ee4e062862', 'volume_name': 'volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862', 'volume_size': 2, 'snapshot_id': '96590d62-0706-431f-97f9-70949116d41e'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfc8989-2367-47fe-a716-3e2e821f15ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfc8989-2367-47fe-a716-3e2e821f15ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d096ef3-eea4-42d4-8250-60025bab2873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:42 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Volume 3ad506b5-4a35-4e91-ba3b-56ee4e062862: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862', 'volume_size': 2, 'snapshot_id': '96590d62-0706-431f-97f9-70949116d41e'}
Jun 29 04:56:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:43 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8" returned: 0 in 1.024s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:43 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8
Jun 29 04:56:43 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:43 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.046s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:43 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce
Jun 29 04:56:43 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:43 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e729851-0630-498c-a6d9-83dd93f06bd8" returned: 0 in 0.709s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-quobyte-9e729851-0630-498c-a6d9-83dd93f06bd8" released by "delete_volume" :: held 1.837s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:43 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Created reservations ['2c79d556-5cbe-4741-831c-4050adb72640', 'fb244109-7bfa-4f7c-8845-f43f47798821', '94497bd9-6464-49af-8420-c3fa278f21eb', 'a94e2e76-29aa-430d-8db6-f2aa44cb228d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:44 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:56:44 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:45 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.924s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:46 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:56:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Deleted volume successfully.
Jun 29 04:56:46 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=89,cinder:INSERT=26,cinder:UPDATE=97,cinder:DELETE=11 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:56:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-31f45dd6-2a12-4c45-8657-8873fc74f2aa tempest-SnapshotMetadataTestJSON-1677673227 None] Lock "cinder-9e729851-0630-498c-a6d9-83dd93f06bd8-delete_volume" released by "delete_volume" :: held 4.168s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce" returned: 0 in 7.539s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39b790-474a-445c-bf5b-fbe9c4323647]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:51 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:56:51 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:52 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.183s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:52 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:56:52 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Converted 1024.00 MB image at 135.81 MB/s
Jun 29 04:56:52 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce is being set with open permissions: ugo+rw
Jun 29 04:56:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:52 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce
Jun 29 04:56:52 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:53 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce" returned: 0 in 0.996s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" released by "_copy_volume_from_snapshot" :: held 11.859s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7-c31268ae-7ffa-481c-bef0-caeb23ea01ce" released by "_create_volume_from_snapshot" :: held 11.902s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.924s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.186s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e-3ad506b5-4a35-4e91-ba3b-56ee4e062862" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e-3ad506b5-4a35-4e91-ba3b-56ee4e062862" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Creating volume 3ad506b5-4a35-4e91-ba3b-56ee4e062862 from snapshot 96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ce64cb-683a-44e4-aa70-38c7813fcf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce', 'volume_size': 1, 'snapshot_id': '8ae64e79-587f-4788-a99f-e17e758ef9d7'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3698d06-c7c8-4c1b-b478-8e18f39e598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] snapshot: 96590d62-0706-431f-97f9-70949116d41e, volume: 3ad506b5-4a35-4e91-ba3b-56ee4e062862,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:56:53 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Volume volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce (c31268ae-7ffa-481c-bef0-caeb23ea01ce): created successfully
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3698d06-c7c8-4c1b-b478-8e18f39e598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Flow 'volume_create_manager' (28081509-90bd-453d-854b-f0c49f74784c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53e848-f423-406d-9823-82287c709cb2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-12a4b761-2914-495e-a63d-de2c50af3123 tempest-TestStampPattern-1842297936 None] Created volume successfully.
Jun 29 04:56:53 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:56:53 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Flow 'volume_create_manager' (1f16d571-3360-4a80-ac02-a226d5e0f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99db7b5-c420-4ed5-9519-7f67b3f7a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:54 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99db7b5-c420-4ed5-9519-7f67b3f7a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-270972292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3b3558af3436594cf5876027ad4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:54Z,use_quota=True,user_id='0421bbbfa0304ff195bb4bee4f4ec893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb3ab6-2003-43af-a309-86e36cb5cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb3ab6-2003-43af-a309-86e36cb5cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba3eb27-1b17-4bab-bb2b-5164fa731dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba3eb27-1b17-4bab-bb2b-5164fa731dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb', 'volume_name': 'volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f8580d-76ec-47a4-91de-3d48bfa150a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f8580d-76ec-47a4-91de-3d48bfa150a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8b8b12-072d-4749-b090-7d7b2e80073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:56:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Volume fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb', 'volume_size': 1}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 1.306s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801bca09-4740-492d-a0bc-e1fd24e9440a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d18cac-30fc-4fdd-a7e6-f98a6804090c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:56:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:54 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:56:54 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:56:55 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jun 29 04:56:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 0.873s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:56:55 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:56:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:56:55 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862
Jun 29 04:56:55 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:03 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862" returned: 0 in 8.018s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:03 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa2902-f8f4-4e8a-bc97-931380cd3853]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:03 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:03 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:57:03 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:04 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=54,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:57:04 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:57:05 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.572s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:57:05 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 2.089s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:57:05 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Converted 1024.00 MB image at 127.64 MB/s
Jun 29 04:57:05 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 is being set with open permissions: ugo+rw
Jun 29 04:57:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:05 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862
Jun 29 04:57:05 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:06 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862" returned: 0 in 1.244s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" released by "_copy_volume_from_snapshot" :: held 13.727s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e-3ad506b5-4a35-4e91-ba3b-56ee4e062862" released by "_create_volume_from_snapshot" :: held 13.801s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.842s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.335s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-270972292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3b3558af3436594cf5876027ad4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:56:54Z,use_quota=True,user_id='0421bbbfa0304ff195bb4bee4f4ec893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Creating volume fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:57:06 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:57:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:06 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb 1073741824
Jun 29 04:57:06 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d096ef3-eea4-42d4-8250-60025bab2873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862', 'volume_size': 2, 'snapshot_id': '96590d62-0706-431f-97f9-70949116d41e'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492ab99-8645-4f53-bcd7-b7e2dda226e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Volume volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 (3ad506b5-4a35-4e91-ba3b-56ee4e062862): created successfully
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492ab99-8645-4f53-bcd7-b7e2dda226e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (dc2264d9-a550-4893-9d70-23c2c7b75df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3d35fb12-49ab-4db8-84d4-90bb01d68deb tempest-VolumesSnapshotTestJSON-99631389 None] Created volume successfully.
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-3ad506b5-4a35-4e91-ba3b-56ee4e062862-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-3ad506b5-4a35-4e91-ba3b-56ee4e062862-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" acquired by "delete_volume" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c958ec-b765-43d0-a2bd-23098eadd148]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:08 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862
Jun 29 04:57:08 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:08 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb 1073741824" returned: 0 in 1.771s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:08 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb
Jun 29 04:57:08 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:09 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862" returned: 0 in 1.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:10 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862
Jun 29 04:57:10 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:10 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" returned: 0 in 1.401s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] <== create_volume: return (3286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.295s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8b8b12-072d-4749-b090-7d7b2e80073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8284ec1-4cdd-45f7-9d89-8720651d205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Volume volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb (fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb): created successfully
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8284ec1-4cdd-45f7-9d89-8720651d205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Flow 'volume_create_manager' (1f16d571-3360-4a80-ac02-a226d5e0f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f5f52b09-7e35-42b0-86a4-7c74459ff025 tempest-AbsoluteLimitsTests-565571266 None] Created volume successfully.
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Acquiring lock "cinder-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "cinder-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Acquiring lock "cinder-quobyte-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "cinder-quobyte-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" acquired by "delete_volume" :: waited 0.071s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Flow 'volume_create_manager' (a94a12b8-dfb7-4425-8626-ae1ba092751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacee7d5-4deb-4dd4-a154-c8f571ffe646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34eb61e-c506-4765-942d-f68b546f4f0e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacee7d5-4deb-4dd4-a154-c8f571ffe646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1052634108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5500384f-20df-4278-bb57-8487460769d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f5650a51643d59d7f2ef76df56e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:11Z,use_quota=True,user_id='9390572967844106a33c8cb9b6cf1ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb83e15-cde3-4e64-8ef6-a065804afa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb83e15-cde3-4e64-8ef6-a065804afa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b309a55-6716-4530-94ff-9c3801b174a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b309a55-6716-4530-94ff-9c3801b174a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5500384f-20df-4278-bb57-8487460769d9', 'volume_name': 'volume-5500384f-20df-4278-bb57-8487460769d9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b3a142-24b3-46eb-b93c-c366213e1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b3a142-24b3-46eb-b93c-c366213e1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17540eb-c05d-459b-abd9-70604db93b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:11 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Volume 5500384f-20df-4278-bb57-8487460769d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5500384f-20df-4278-bb57-8487460769d9', 'volume_size': 1}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1052634108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5500384f-20df-4278-bb57-8487460769d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f5650a51643d59d7f2ef76df56e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:11Z,use_quota=True,user_id='9390572967844106a33c8cb9b6cf1ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Creating volume 5500384f-20df-4278-bb57-8487460769d9 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:57:11 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:11 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 1073741824
Jun 29 04:57:11 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:11 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3ad506b5-4a35-4e91-ba3b-56ee4e062862" returned: 0 in 1.654s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:11 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb
Jun 29 04:57:11 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-3ad506b5-4a35-4e91-ba3b-56ee4e062862" released by "delete_volume" :: held 3.742s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['c3dad571-6249-49f3-9737-a68af37ffad9', '821d8a47-769b-4ec5-bfa9-6cf2a6aab128', '536f2364-2b58-4a5e-ba06-5e36184fc2ce', 'df4b1426-ed9f-4ed3-a76e-3136f0fcf946'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:12 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:12 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-96590d62-0706-431f-97f9-70949116d41e-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:12 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" returned: 0 in 1.579s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-96590d62-0706-431f-97f9-70949116d41e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:13 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb
Jun 29 04:57:13 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Deleting offline snapshot 96590d62-0706-431f-97f9-70949116d41e of volume 801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] snapshot_file for this snap is: volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c47b3-a9c6-4891-becc-1b3a2006fa0e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:13 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.300s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Deleted volume successfully.
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-851a86db-8ef5-4a5a-824d-d8aa870ca330 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-3ad506b5-4a35-4e91-ba3b-56ee4e062862-delete_volume" released by "delete_volume" :: held 5.569s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:13 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:57:13 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:13 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 1073741824" returned: 0 in 2.279s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:13 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9
Jun 29 04:57:13 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:14 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" returned: 0 in 1.256s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "cinder-quobyte-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb" released by "delete_volume" :: held 2.944s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Created reservations ['74ea9cdb-9775-4b2b-9826-1287c4313315', '673af146-18e0-4c1f-8b37-38cdb18fe810', 'acbc8578-3fba-4c1e-a816-279389688d9b', '27482a6b-d286-426c-8f6c-bb7062909bd2'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:14 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 1.160s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801bca09-4740-492d-a0bc-e1fd24e9440a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca33e6a-c103-4333-adea-2317a4a73d78]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:14 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:14 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:14 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:57:14 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:15 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9" returned: 0 in 1.338s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] <== create_volume: return (3692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.695s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17540eb-c05d-459b-abd9-70604db93b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5500384f-20df-4278-bb57-8487460769d9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f9a65f-1ba0-438c-94fd-86c48fec9050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:15 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Volume volume-5500384f-20df-4278-bb57-8487460769d9 (5500384f-20df-4278-bb57-8487460769d9): created successfully
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f9a65f-1ba0-438c-94fd-86c48fec9050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Flow 'volume_create_manager' (a94a12b8-dfb7-4425-8626-ae1ba092751e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-63539ebe-600c-4194-930b-7bca7b6c76e4 tempest-TestMinimumBasicScenario-1369822509 None] Created volume successfully.
Jun 29 04:57:15 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 1.055s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:15 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.112s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:15 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:57:15 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Deleted volume successfully.
Jun 29 04:57:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b167214c-7e5f-442d-b610-5ea5d8926993 tempest-AbsoluteLimitsTests-565571266 None] Lock "cinder-fed8ed45-eff6-4b4d-aaf3-4b88c0d647bb-delete_volume" released by "delete_volume" :: held 4.475s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:16 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 0.941s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:16 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e
Jun 29 04:57:16 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:17 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a.96590d62-0706-431f-97f9-70949116d41e" returned: 0 in 0.853s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-96590d62-0706-431f-97f9-70949116d41e" released by "_delete_snapshot" :: held 4.209s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" released by "delete_snapshot" :: held 4.266s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['9b7ab2bf-5c82-478b-b844-591d714542a8', '45132c95-c350-4b75-b712-83c090d66fb7', '67344773-3b89-4b3e-8476-e4d49ceb2e86', 'b763878b-48d6-4250-ac24-c0d686905430'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Delete snapshot completed successfully.
Jun 29 04:57:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-13d34ff9-e99d-4ee4-84c3-f28a12b76ce1 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-96590d62-0706-431f-97f9-70949116d41e-delete_snapshot" released by "delete_snapshot" :: held 4.463s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-801bca09-4740-492d-a0bc-e1fd24e9440a-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-801bca09-4740-492d-a0bc-e1fd24e9440a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545b74b-9f31-4db9-8eea-dbf354b17504]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:18 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:57:18 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8b6724-71f2-4ce2-97df-ddc3500460ed]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:19 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9
Jun 29 04:57:19 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:19 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 1.052s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:19 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a
Jun 29 04:57:19 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:20 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9" returned: 0 in 0.996s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.018s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-5500384f-20df-4278-bb57-8487460769d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6fdeb38-d40b-4eb6-8d06-34e5eae7b6a1', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:57:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-34c2faf1-8660-4199-b6cc-d3cbce88c40c req-57835dbb-805e-42e0-b119-942c6bcc0bf4 tempest-TestMinimumBasicScenario-1369822509 None] attachment_update completed successfully.
Jun 29 04:57:20 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-801bca09-4740-492d-a0bc-e1fd24e9440a" returned: 0 in 0.849s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-801bca09-4740-492d-a0bc-e1fd24e9440a" released by "delete_volume" :: held 2.003s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['bdf9d164-9266-497a-9862-3ce017e9062f', '1b66bbf7-c0da-47b0-8f66-4fb1f97fbb61', '6f12a07c-703a-45f0-9f16-f3d6c2925f35', '014020bd-3e9a-4f17-b3c5-da4886cff43d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:20 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:20 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:21 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.736s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:21 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Deleted volume successfully.
Jun 29 04:57:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8f64f48-f692-4c20-a3e7-d66819e9218c tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-801bca09-4740-492d-a0bc-e1fd24e9440a-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (44443c07-e76f-40e7-a9ec-65237b958265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2214db1f-3d18-4d05-9527-5acb05e335f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2214db1f-3d18-4d05-9527-5acb05e335f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-586874345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a58f94a-59c2-4957-abf7-751305cb5afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:22Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca796b56-b63c-4e30-bd99-374e107aa0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca796b56-b63c-4e30-bd99-374e107aa0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013c9390-2e2f-4727-86f2-0a84ab7cebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013c9390-2e2f-4727-86f2-0a84ab7cebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a58f94a-59c2-4957-abf7-751305cb5afe', 'volume_name': 'volume-8a58f94a-59c2-4957-abf7-751305cb5afe', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5515c6ad-4575-4362-b8ac-25e64f5ba00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5515c6ad-4575-4362-b8ac-25e64f5ba00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54eea32-442e-47f1-bd65-743effcd4be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:22 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Volume 8a58f94a-59c2-4957-abf7-751305cb5afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a58f94a-59c2-4957-abf7-751305cb5afe', 'volume_size': 1}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-586874345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a58f94a-59c2-4957-abf7-751305cb5afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:22Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Creating volume 8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:57:22 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:57:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:22 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe 1073741824
Jun 29 04:57:22 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:23 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe 1073741824" returned: 0 in 0.972s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:23 devstack sudo[108030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:23 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:24 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 0.742s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54eea32-442e-47f1-bd65-743effcd4be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a58f94a-59c2-4957-abf7-751305cb5afe', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be816363-55df-45a0-8b1e-8aeb29240c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:24 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Volume volume-8a58f94a-59c2-4957-abf7-751305cb5afe (8a58f94a-59c2-4957-abf7-751305cb5afe): created successfully
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be816363-55df-45a0-8b1e-8aeb29240c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (44443c07-e76f-40e7-a9ec-65237b958265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c2afea1f-649d-4a64-9b08-00dd821a4412 tempest-VolumesSnapshotTestJSON-99631389 None] Created volume successfully.
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Creating offline snapshot 1791e8c8-8d9a-4ded-8956-f544ba537970 of volume 8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f02c58-8ff2-4426-90c5-4a2b192a4b89]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:25 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:25 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:25 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 0.790s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:25 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 1G
Jun 29 04:57:25 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:26 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 1G" returned: 0 in 1.194s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a58f94a-59c2-4957-abf7-751305cb5afe -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:26 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a58f94a-59c2-4957-abf7-751305cb5afe -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:26 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:27 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a58f94a-59c2-4957-abf7-751305cb5afe -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 0.944s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:27 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 is being set with open permissions: ugo+rw
Jun 29 04:57:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:27 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:27 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:29 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 1.344s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:29 devstack sudo[108060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info
Jun 29 04:57:29 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:30 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info" returned: 0 in 1.265s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:30 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info is being set with open permissions: ugo+rw
Jun 29 04:57:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:30 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info
Jun 29 04:57:30 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Flow 'volume_create_manager' (08b2e434-f7e7-4816-ad3c-794003392bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6387a47-52d9-431d-afdb-877bfe7fc4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6387a47-52d9-431d-afdb-877bfe7fc4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2140576103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0011ffb9-63ae-49f5-b2a3-1a22a603eca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50710d468cb40b68f3d1f949f01da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:31Z,use_quota=True,user_id='3fc425418bae493fbfc88f1c4a325538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca05668-bab1-4301-b02b-e66bba687152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca05668-bab1-4301-b02b-e66bba687152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca814a01-9baa-48d6-9566-795c1f27c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca814a01-9baa-48d6-9566-795c1f27c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0011ffb9-63ae-49f5-b2a3-1a22a603eca4', 'volume_name': 'volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048ab92f-33f5-45a7-8b98-9757d169be14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048ab92f-33f5-45a7-8b98-9757d169be14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19785e2-4936-413c-a2ce-fcdd27df03ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:31 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4', 'volume_size': 1}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:31 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.info" returned: 0 in 0.959s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.658s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2140576103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0011ffb9-63ae-49f5-b2a3-1a22a603eca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50710d468cb40b68f3d1f949f01da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:31Z,use_quota=True,user_id='3fc425418bae493fbfc88f1c4a325538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Creating volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:57:31 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:57:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:31 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 1073741824
Jun 29 04:57:31 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-27e6a709-8121-422a-b394-3403c1cf3a40 tempest-VolumesSnapshotTestJSON-99631389 None] Create snapshot completed successfully
Jun 29 04:57:32 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 1073741824" returned: 0 in 0.964s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:32 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:57:32 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (9c9d559e-ebe1-493e-94fe-382abbb494a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072f3272-50f6-49ed-a68e-e247f4a2f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072f3272-50f6-49ed-a68e-e247f4a2f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-980818289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fd5204-8da1-4fe0-af3b-545efb91ce8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd3631c732b404d8e323e39fed454d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1791e8c8-8d9a-4ded-8956-f544ba537970,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:57:33Z,use_quota=True,user_id='a741ea9681d44f6599dc885f25fb0b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18348879-27f2-4e19-9462-e2663f18ec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18348879-27f2-4e19-9462-e2663f18ec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70de416c-9ba9-4da1-9be8-9da9846a8fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70de416c-9ba9-4da1-9be8-9da9846a8fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4fd5204-8da1-4fe0-af3b-545efb91ce8c', 'volume_name': 'volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c', 'volume_size': 1, 'snapshot_id': '1791e8c8-8d9a-4ded-8956-f544ba537970'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae418f5-99a6-47ef-8e07-d3274e0066c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae418f5-99a6-47ef-8e07-d3274e0066c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99beaefc-57ba-4793-bfd1-aec2d9c709df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Volume e4fd5204-8da1-4fe0-af3b-545efb91ce8c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c', 'volume_size': 1, 'snapshot_id': '1791e8c8-8d9a-4ded-8956-f544ba537970'}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:33 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.882s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.153s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19785e2-4936-413c-a2ce-fcdd27df03ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da4be40-f02c-4bd5-927a-c43a44d0af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Creating volume e4fd5204-8da1-4fe0-af3b-545efb91ce8c from snapshot 1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Volume volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 (0011ffb9-63ae-49f5-b2a3-1a22a603eca4): created successfully
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da4be40-f02c-4bd5-927a-c43a44d0af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Flow 'volume_create_manager' (08b2e434-f7e7-4816-ad3c-794003392bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] snapshot: 1791e8c8-8d9a-4ded-8956-f544ba537970, volume: e4fd5204-8da1-4fe0-af3b-545efb91ce8c,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 04:57:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-01d9b658-c3f1-49f2-9aa8-0304637b8faa tempest-VolumesActionsTest-1949287777 None] Created volume successfully.
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f05e1-4700-49ee-aa58-627e652b5d26]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:33 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:33 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:34 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 1.002s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a58f94a-59c2-4957-abf7-751305cb5afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[303cca57-a459-4cf2-9d63-20a154efc504]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:34 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:34 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:35 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 0.998s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:35 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 04:57:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:35 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c
Jun 29 04:57:35 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:41 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" returned: 0 in 6.324s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21e033-a5cf-49ed-8676-b0baa2a86c15]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:42 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:42 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:42 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 0.955s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:42 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:57:42 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Converted 1024.00 MB image at 161.89 MB/s
Jun 29 04:57:42 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c is being set with open permissions: ugo+rw
Jun 29 04:57:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:42 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c
Jun 29 04:57:42 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:43 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" returned: 0 in 0.815s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" released by "_copy_volume_from_snapshot" :: held 10.238s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" released by "_create_volume_from_snapshot" :: held 10.299s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.337s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.338s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc6d26a-43b7-401f-97e8-86f34e43914e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99beaefc-57ba-4793-bfd1-aec2d9c709df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c', 'volume_size': 1, 'snapshot_id': '1791e8c8-8d9a-4ded-8956-f544ba537970'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbf4b69-330f-40d0-8626-50d0d279c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:57:43 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Volume volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c (e4fd5204-8da1-4fe0-af3b-545efb91ce8c): created successfully
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbf4b69-330f-40d0-8626-50d0d279c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:57:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Flow 'volume_create_manager' (9c9d559e-ebe1-493e-94fe-382abbb494a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:57:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6a55f005-fa5d-4877-887d-71cf7fa64517 tempest-VolumesSnapshotTestJSON-99631389 None] Created volume successfully.
Jun 29 04:57:43 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce
Jun 29 04:57:43 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-e4fd5204-8da1-4fe0-af3b-545efb91ce8c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-e4fd5204-8da1-4fe0-af3b-545efb91ce8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda96f89-ef61-41f3-b408-f94aa45c18b5]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:44 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c
Jun 29 04:57:44 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:44 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce" returned: 0 in 1.103s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.135s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bb00edf-866d-432b-bd62-d74556726937', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 04:57:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-f5023fed-bf49-4c19-9171-0c5fde8b690e req-4d96ea58-5610-428b-9319-20259ee7fbc3 tempest-TestStampPattern-1842297936 None] attachment_update completed successfully.
Jun 29 04:57:45 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" returned: 0 in 0.932s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:45 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c
Jun 29 04:57:45 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:46 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" returned: 0 in 0.744s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-e4fd5204-8da1-4fe0-af3b-545efb91ce8c" released by "delete_volume" :: held 1.746s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['c723ee2a-a931-42a1-9df4-0753ba7e8ae0', 'fff64626-e7f0-4b4b-b881-03ab50ad5b3f', '423e23ce-f993-4545-9aa9-28d6bd1051f8', '7c6f86db-8286-405a-bd71-7f8534a90896'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:46 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:46 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-1791e8c8-8d9a-4ded-8956-f544ba537970-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-1791e8c8-8d9a-4ded-8956-f544ba537970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Deleting offline snapshot 1791e8c8-8d9a-4ded-8956-f544ba537970 of volume 8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] snapshot_file for this snap is: volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3def19ee-d85e-4a59-bb6c-26704ca862b0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:47 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:47 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:47 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.861s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:47 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Deleted volume successfully.
Jun 29 04:57:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ef25335c-5357-46d5-80ec-8e4f94c9ef23 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-e4fd5204-8da1-4fe0-af3b-545efb91ce8c-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:47 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 1.017s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a58f94a-59c2-4957-abf7-751305cb5afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:57:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[44558778-a881-4ce1-bac8-293c5101414c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:48 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:48 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:49 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 1.338s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:49 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:49 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:50 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 0.895s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:50 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970
Jun 29 04:57:50 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:51 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe.1791e8c8-8d9a-4ded-8956-f544ba537970" returned: 0 in 0.763s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-1791e8c8-8d9a-4ded-8956-f544ba537970" released by "_delete_snapshot" :: held 4.182s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" released by "delete_snapshot" :: held 4.209s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:51 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['27589ab2-4a45-4e99-805a-1fc62f84460e', '9ae77580-f9d9-4dd4-a427-e3b7de7962f3', 'a2378044-6a60-4254-ac1b-6cefdff0d31b', '0ca1cfc3-0432-4f17-859f-9e673d373244'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Delete snapshot completed successfully.
Jun 29 04:57:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-db5570dc-c0a4-4dc6-a071-d837c5d6c2e3 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-1791e8c8-8d9a-4ded-8956-f544ba537970-delete_snapshot" released by "delete_snapshot" :: held 4.378s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-8a58f94a-59c2-4957-abf7-751305cb5afe-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-8a58f94a-59c2-4957-abf7-751305cb5afe-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" acquired by "delete_volume" :: waited 0.047s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3bc817-a78d-4c12-9c23-fcb96d9ad3b1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:53 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:53 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-626c77cb-c059-4d34-bcac-9600b4f944c9 req-2d735545-5e2b-4ab1-a301-ae9f9918a10f tempest-TestStampPattern-1842297936 None] Terminate volume connection completed successfully.
Jun 29 04:57:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-626c77cb-c059-4d34-bcac-9600b4f944c9 req-2d735545-5e2b-4ab1-a301-ae9f9918a10f tempest-TestStampPattern-1842297936 None] Deleting attachment 0bb00edf-866d-432b-bd62-d74556726937. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:57:54 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 1.379s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:54 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe
Jun 29 04:57:54 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:55 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8a58f94a-59c2-4957-abf7-751305cb5afe" returned: 0 in 0.980s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-8a58f94a-59c2-4957-abf7-751305cb5afe" released by "delete_volume" :: held 2.505s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['5cf5254f-249e-4def-b747-fd1e7098952a', '4a6f0a46-534c-49ab-9fde-fc260661f24e', '20919b23-566b-4aa2-a85a-42a19b5430b7', '7225c3c8-d612-488e-ab1d-233ccdfde53e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:57:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:55 devstack sudo[108481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:57:55 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-662d2a61-ced2-4180-a76b-9aef9289bf88-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-662d2a61-ced2-4180-a76b-9aef9289bf88-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:56 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.923s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Deleted volume successfully.
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" acquired by "delete_volume" :: waited 0.047s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cb6447-8b7a-4b95-8249-4c2e188180e8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2b396d2e-eaae-4320-a06e-088e746f648a tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-8a58f94a-59c2-4957-abf7-751305cb5afe-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:56 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88
Jun 29 04:57:56 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e95b05-9390-432e-b6d3-d4a2c9a136a4 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" by "attach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e95b05-9390-432e-b6d3-d4a2c9a136a4 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" acquired by "attach_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-03e95b05-9390-432e-b6d3-d4a2c9a136a4 tempest-VolumesActionsTest-1949287777 None] Attaching volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4 to instance 4fa84523-4248-4ae7-8e51-c878134f01fb at mountpoint /dev/vdb on host None.
Jun 29 04:57:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-03e95b05-9390-432e-b6d3-d4a2c9a136a4 tempest-VolumesActionsTest-1949287777 None] Attach volume completed successfully.
Jun 29 04:57:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-03e95b05-9390-432e-b6d3-d4a2c9a136a4 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" released by "attach_volume" :: held 0.144s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb8c2b07-4714-49fc-aeb5-956943983560 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" by "detach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:57:58 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88" returned: 0 in 1.549s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:57:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb8c2b07-4714-49fc-aeb5-956943983560 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" acquired by "detach_volume" :: waited 0.151s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:57:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb8c2b07-4714-49fc-aeb5-956943983560 tempest-VolumesActionsTest-1949287777 None] Detaching volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4 from instance 4fa84523-4248-4ae7-8e51-c878134f01fb.
Jun 29 04:57:58 devstack sudo[108498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88
Jun 29 04:57:58 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:57:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb8c2b07-4714-49fc-aeb5-956943983560 tempest-VolumesActionsTest-1949287777 None] Detach volume completed successfully.
Jun 29 04:57:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb8c2b07-4714-49fc-aeb5-956943983560 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" released by "detach_volume" :: held 0.291s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:59 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root
Jun 29 04:57:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-662d2a61-ced2-4180-a76b-9aef9289bf88" returned: 0 in 1.521s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:57:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-quobyte-662d2a61-ced2-4180-a76b-9aef9289bf88" released by "delete_volume" :: held 3.209s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:57:59 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Created reservations ['c9f0d733-f290-44ea-9589-a78df0693481', 'b6e78f35-37e3-456e-914b-a2531410bdc6', '9f9bc005-4ec5-4611-b0cb-d6e3be32dc57', '9618b824-5519-4d60-b000-984f9f6ae7be'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:00 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:00 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:01 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.224s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:01 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Deleted volume successfully.
Jun 29 04:58:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-eb412a4c-2a42-4e15-8b2e-937a5a40b295 tempest-VolumesSnapshotTestJSON-99631389 None] Lock "cinder-662d2a61-ced2-4180-a76b-9aef9289bf88-delete_volume" released by "delete_volume" :: held 5.097s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:03 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:03 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:04 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.798s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:58:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:58:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-c31268ae-7ffa-481c-bef0-caeb23ea01ce-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "cinder-c31268ae-7ffa-481c-bef0-caeb23ea01ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=72,cinder:UPDATE=88,cinder:DELETE=5,cinder:INSERT=13 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=76,cinder:SELECT=75,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f19ab-c41e-45c0-988d-edf401074e97]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:05 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce
Jun 29 04:58:05 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:06 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce" returned: 0 in 0.887s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:06 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce
Jun 29 04:58:06 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:06 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c31268ae-7ffa-481c-bef0-caeb23ea01ce" returned: 0 in 0.669s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-c31268ae-7ffa-481c-bef0-caeb23ea01ce" released by "delete_volume" :: held 1.602s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:06 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Created reservations ['75f4c00c-ed89-46cf-abc4-a756b470dcca', '8f350baf-5e80-4cc2-9c88-b6cd886bd1bd', '3771c912-00f5-4f07-b259-72ee14599324', '92db93da-933f-4293-932b-a7b6f6bb6a7b'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:07 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:07 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-8ae64e79-587f-4788-a99f-e17e758ef9d7-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-8ae64e79-587f-4788-a99f-e17e758ef9d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:07 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.874s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Deleted volume successfully.
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a5738570-fe75-4283-b900-64c196ed5212 tempest-TestStampPattern-1842297936 None] Lock "cinder-c31268ae-7ffa-481c-bef0-caeb23ea01ce-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Deleting offline snapshot 8ae64e79-587f-4788-a99f-e17e758ef9d7 of volume 8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] snapshot_file for this snap is: volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf76371c-b8b1-4191-b54d-5e98546f2c54]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (d4b08d25-203b-4c9e-82be-aa94415314fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b2991-7998-4ed4-a104-d3a7979f34b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b2991-7998-4ed4-a104-d3a7979f34b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883373857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f144f05-6507-4e4c-94cf-282d740b33ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:08Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:08 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:58:08 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a92258-c7b0-493f-be84-47755465edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a92258-c7b0-493f-be84-47755465edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c97935-295b-4e10-b6b3-7fc46261c65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c97935-295b-4e10-b6b3-7fc46261c65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f144f05-6507-4e4c-94cf-282d740b33ea', 'volume_name': 'volume-2f144f05-6507-4e4c-94cf-282d740b33ea', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecf550c-a286-41b4-89a9-5b06cb79ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecf550c-a286-41b4-89a9-5b06cb79ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a71e656-375b-40f9-9673-50f1feca1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:08 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume 2f144f05-6507-4e4c-94cf-282d740b33ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f144f05-6507-4e4c-94cf-282d740b33ea', 'volume_size': 1}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883373857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f144f05-6507-4e4c-94cf-282d740b33ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:08Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume 2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:08 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:08 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea 1073741824
Jun 29 04:58:08 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:08 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 0.834s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e53464a-dbcf-49c1-9f80-7275bd429432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddadc0-1e86-4e15-aa17-762a462069f2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:09 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:58:09 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:09 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea 1073741824" returned: 0 in 0.904s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:09 devstack sudo[108611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea
Jun 29 04:58:09 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:09 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 0.864s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:09 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:58:09 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:09 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea" returned: 0 in 0.787s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a71e656-375b-40f9-9673-50f1feca1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f144f05-6507-4e4c-94cf-282d740b33ea', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38579e4-1fe6-4f54-9a54-72ee0419323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-2f144f05-6507-4e4c-94cf-282d740b33ea (2f144f05-6507-4e4c-94cf-282d740b33ea): created successfully
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38579e4-1fe6-4f54-9a54-72ee0419323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (d4b08d25-203b-4c9e-82be-aa94415314fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4f39f87f-87f8-403a-851e-511c32110097 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:10 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:10 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7
Jun 29 04:58:10 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:11 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432.8ae64e79-587f-4788-a99f-e17e758ef9d7" returned: 0 in 0.815s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating offline snapshot 539765e9-2e52-405e-b624-c1b741e5d4df of volume 2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[495dc591-6e20-44e2-94af-0601c02c2851]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8ae64e79-587f-4788-a99f-e17e758ef9d7" released by "_delete_snapshot" :: held 3.561s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" released by "delete_snapshot" :: held 3.599s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Created reservations ['674d1f90-5812-41bb-b018-ad24b01312e6', '77b3ff0e-3231-4ced-9401-b8027fb14ef1', '35bd2abc-5822-4d94-a636-c12690be2335', 'a3a03dab-b657-444e-9441-c57fe1c04a05'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:11 devstack sudo[108666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea
Jun 29 04:58:11 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Delete snapshot completed successfully.
Jun 29 04:58:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9c84e652-d85d-4d01-b756-e94c6d16f533 tempest-TestStampPattern-1842297936 None] Lock "cinder-8ae64e79-587f-4788-a99f-e17e758ef9d7-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:12 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea" returned: 0 in 1.020s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:12 devstack sudo[108673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df 1G
Jun 29 04:58:12 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:13 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df 1G" returned: 0 in 1.115s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f144f05-6507-4e4c-94cf-282d740b33ea -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:13 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f144f05-6507-4e4c-94cf-282d740b33ea -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df
Jun 29 04:58:13 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:14 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f144f05-6507-4e4c-94cf-282d740b33ea -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df" returned: 0 in 1.062s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:14 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df is being set with open permissions: ugo+rw
Jun 29 04:58:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:14 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df
Jun 29 04:58:14 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-c0422351-85c6-4b6f-b798-50f4eab72fa9 req-141846e6-5bd9-431e-ad5b-d4e736d939c8 tempest-TestMinimumBasicScenario-1369822509 None] Terminate volume connection completed successfully.
Jun 29 04:58:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-c0422351-85c6-4b6f-b798-50f4eab72fa9 req-141846e6-5bd9-431e-ad5b-d4e736d939c8 tempest-TestMinimumBasicScenario-1369822509 None] Deleting attachment a6fdeb38-d40b-4eb6-8d06-34e5eae7b6a1. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 04:58:15 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:15 devstack sudo[108746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info
Jun 29 04:58:15 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:16 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info" returned: 0 in 0.813s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:16 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info is being set with open permissions: ugo+rw
Jun 29 04:58:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:16 devstack sudo[108766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info
Jun 29 04:58:16 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "cinder-5500384f-20df-4278-bb57-8487460769d9-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "cinder-5500384f-20df-4278-bb57-8487460769d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "cinder-quobyte-5500384f-20df-4278-bb57-8487460769d9" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "cinder-quobyte-5500384f-20df-4278-bb57-8487460769d9" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f77f0-4b13-48e9-ab3a-d38c1e734b4f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:17 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.info" returned: 0 in 0.758s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.791s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:17 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b2bc996b-d8c8-4de3-9edf-3d2737442197 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Create snapshot completed successfully
Jun 29 04:58:17 devstack sudo[108770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9
Jun 29 04:58:17 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:18 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9" returned: 0 in 1.118s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:18 devstack sudo[108776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9
Jun 29 04:58:18 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (c1f04d0f-18fe-4454-82ad-541ffe324251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4128737f-c26f-427f-a97a-627600167bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4128737f-c26f-427f-a97a-627600167bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66078742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c16249e-b5c9-4b71-af01-2fb5b480e70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:18Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dead1d5c-e988-4aa0-9761-02a1f46875df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dead1d5c-e988-4aa0-9761-02a1f46875df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fa919f-bcda-4dcb-a3b9-87bf7b6ff54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fa919f-bcda-4dcb-a3b9-87bf7b6ff54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c16249e-b5c9-4b71-af01-2fb5b480e70f', 'volume_name': 'volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d629bed9-70de-4fdd-9592-857ad7d4f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d629bed9-70de-4fdd-9592-857ad7d4f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f856a06-7015-4d7b-b0b0-59a070228c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume 7c16249e-b5c9-4b71-af01-2fb5b480e70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f', 'volume_size': 1}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66078742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c16249e-b5c9-4b71-af01-2fb5b480e70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:18Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume 7c16249e-b5c9-4b71-af01-2fb5b480e70f {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:18 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:18 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f 1073741824
Jun 29 04:58:18 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (80e1ed79-e7f3-489a-b86b-1e6b03477179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928a99f-8c63-4ba4-907e-1e2c79cf0389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a928a99f-8c63-4ba4-907e-1e2c79cf0389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098259469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4225901-6d6c-4eaf-aacf-c3e4e6cb3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:19Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a278a6bc-19e2-426e-b0f3-4e541dcd377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a278a6bc-19e2-426e-b0f3-4e541dcd377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1327499d-2884-44c5-8cd5-cb39760de879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1327499d-2884-44c5-8cd5-cb39760de879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4225901-6d6c-4eaf-aacf-c3e4e6cb3053', 'volume_name': 'volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724eced0-86ca-4ab1-83ac-072bbb94470f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724eced0-86ca-4ab1-83ac-072bbb94470f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7883e-c036-4282-aee2-4123d2ccb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume f4225901-6d6c-4eaf-aacf-c3e4e6cb3053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053', 'volume_size': 1}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:19 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5500384f-20df-4278-bb57-8487460769d9" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "cinder-quobyte-5500384f-20df-4278-bb57-8487460769d9" released by "delete_volume" :: held 2.052s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Created reservations ['2a913a74-0351-4f85-b3f0-4ce8d631db02', '8ea69c76-ef2a-41d1-86dd-aa6c707dc0bb', '23c39341-e920-47fd-bd1e-f85b4cf71c0b', '3bfbf8c5-f5c8-48dd-bc60-68d8fdb16228'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:19 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:19 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (81e3bd8f-b4e1-46b2-b5f2-5ebfdfb91922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23430003-7cb1-4fac-a3e9-662e10ab733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23430003-7cb1-4fac-a3e9-662e10ab733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392205712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2010f715-ba60-4b41-86e5-23b0f02664f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:19Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1872c70-8b41-4eb4-b166-f2977ec8f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1872c70-8b41-4eb4-b166-f2977ec8f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a323e5c-e1b5-4c50-a262-f0c40482c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a323e5c-e1b5-4c50-a262-f0c40482c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2010f715-ba60-4b41-86e5-23b0f02664f5', 'volume_name': 'volume-2010f715-ba60-4b41-86e5-23b0f02664f5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b74e0b-b0b3-4c9a-a50c-28d1d8160a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b74e0b-b0b3-4c9a-a50c-28d1d8160a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a472ba1-66ac-4289-8be4-abc32435df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:19 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume 2010f715-ba60-4b41-86e5-23b0f02664f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2010f715-ba60-4b41-86e5-23b0f02664f5', 'volume_size': 1}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:19 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f 1073741824" returned: 0 in 1.265s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:19 devstack sudo[108791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f
Jun 29 04:58:19 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (8eae6dc6-452b-4695-9405-9bf1bd155152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989e5a52-4bb1-4f72-9f2b-735cf4766f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989e5a52-4bb1-4f72-9f2b-735cf4766f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400824545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec8d90e-e617-427d-b0ef-c67e9ae5d6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:20Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f56a25f-b191-4876-b7ce-158c2d26d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f56a25f-b191-4876-b7ce-158c2d26d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8cba75-6709-4d97-a140-22ae1e02b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8cba75-6709-4d97-a140-22ae1e02b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec8d90e-e617-427d-b0ef-c67e9ae5d6af', 'volume_name': 'volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3e4b54-6406-4602-a5fb-33ba5f38ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3e4b54-6406-4602-a5fb-33ba5f38ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc09e9a-b409-4aa6-be93-3f91575c0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume 8ec8d90e-e617-427d-b0ef-c67e9ae5d6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af', 'volume_size': 1}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:20 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.898s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Deleted volume successfully.
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d52485ac-7c74-4d12-89a0-f2f9ab8023d7 tempest-TestMinimumBasicScenario-1369822509 None] Lock "cinder-5500384f-20df-4278-bb57-8487460769d9-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (79d92159-18f5-43f5-9fde-17d11f575a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0385a-8d93-4444-b1d7-3be434b1e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0385a-8d93-4444-b1d7-3be434b1e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552333038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:20Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f4f5fe-0455-4471-8c03-9e391de6d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f4f5fe-0455-4471-8c03-9e391de6d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204e171f-307f-424a-88f2-e4975584579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204e171f-307f-424a-88f2-e4975584579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c', 'volume_name': 'volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c766cc35-81b9-40d1-9d88-457656dd8d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c766cc35-81b9-40d1-9d88-457656dd8d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a23cd36-c274-4ebc-a858-0d3e3df7379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume 6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c', 'volume_size': 1}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:20 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f" returned: 0 in 0.780s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1098259469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4225901-6d6c-4eaf-aacf-c3e4e6cb3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:19Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:20 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 1073741824
Jun 29 04:58:20 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f856a06-7015-4d7b-b0b0-59a070228c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d8a261-0024-4030-bd65-b34fcb907df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f (7c16249e-b5c9-4b71-af01-2fb5b480e70f): created successfully
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d8a261-0024-4030-bd65-b34fcb907df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:20 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (c1f04d0f-18fe-4454-82ad-541ffe324251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0c365560-c0e3-4f90-a84a-cb7f4df93c25 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-8e53464a-dbcf-49c1-9f80-7275bd429432-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "cinder-8e53464a-dbcf-49c1-9f80-7275bd429432-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Acquiring lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" acquired by "delete_volume" :: waited 0.053s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea8dcf7-608a-47d3-b9f8-dfb025ddfd43]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:21 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 1073741824" returned: 0 in 1.261s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:21 devstack sudo[108874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053
Jun 29 04:58:21 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:22 devstack sudo[108866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:58:22 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:23 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" returned: 0 in 1.343s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (2674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.549s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392205712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2010f715-ba60-4b41-86e5-23b0f02664f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:19Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume 2010f715-ba60-4b41-86e5-23b0f02664f5 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:23 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7883e-c036-4282-aee2-4123d2ccb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:23 devstack sudo[108932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 1073741824
Jun 29 04:58:23 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0cc25-43ea-4655-85e2-e1ff8c984ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:23 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 (f4225901-6d6c-4eaf-aacf-c3e4e6cb3053): created successfully
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0cc25-43ea-4655-85e2-e1ff8c984ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (80e1ed79-e7f3-489a-b86b-1e6b03477179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a07a4761-c296-4d29-ba91-c006b602e614 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:23 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.810s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:23 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432
Jun 29 04:58:23 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:24 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 1073741824" returned: 0 in 1.583s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:24 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8e53464a-dbcf-49c1-9f80-7275bd429432" returned: 0 in 1.296s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "cinder-quobyte-8e53464a-dbcf-49c1-9f80-7275bd429432" released by "delete_volume" :: held 3.268s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:25 devstack sudo[108948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5
Jun 29 04:58:25 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Created reservations ['60600325-a4c0-45cd-82d8-2b98f4b0a5d6', '2a56c8d0-e915-4af3-aa67-fbdaa94b54b6', '2f6ee466-fc99-4459-bd09-7f6af7efd123', 'a68d6921-9b24-435f-b31d-a3366bfba5ae'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:25 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:25 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:26 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d9627b-dabb-492a-b6f9-65e344a1aa00 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" by "attach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5" returned: 0 in 1.087s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (2751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.755s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.960s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400824545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec8d90e-e617-427d-b0ef-c67e9ae5d6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:20Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume 8ec8d90e-e617-427d-b0ef-c67e9ae5d6af {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d9627b-dabb-492a-b6f9-65e344a1aa00 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" acquired by "attach_volume" :: waited 0.055s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:26 devstack sudo[108956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af 1073741824
Jun 29 04:58:26 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a472ba1-66ac-4289-8be4-abc32435df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2010f715-ba60-4b41-86e5-23b0f02664f5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8846bee4-b0ea-4e9b-8435-dbb5580bd1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-2010f715-ba60-4b41-86e5-23b0f02664f5 (2010f715-ba60-4b41-86e5-23b0f02664f5): created successfully
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8846bee4-b0ea-4e9b-8435-dbb5580bd1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (81e3bd8f-b4e1-46b2-b5f2-5ebfdfb91922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:26 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.825s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-30df0181-3f4f-4533-b36d-671620255221 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Deleted volume successfully.
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a6ac687a-03fd-4e46-aaed-a4d6f1067f0a tempest-TestStampPattern-1842297936 None] Lock "cinder-8e53464a-dbcf-49c1-9f80-7275bd429432-delete_volume" released by "delete_volume" :: held 4.720s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f2d9627b-dabb-492a-b6f9-65e344a1aa00 tempest-VolumesActionsTest-1949287777 None] Attaching volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4 to instance 57c25ebc-3e74-4978-8f8a-c8151c318869 at mountpoint /dev/vdb on host None.
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f2d9627b-dabb-492a-b6f9-65e344a1aa00 tempest-VolumesActionsTest-1949287777 None] Attach volume completed successfully.
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f2d9627b-dabb-492a-b6f9-65e344a1aa00 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" released by "attach_volume" :: held 0.230s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5024e3e5-228e-4594-bd94-0abcaf70de50 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" by "detach_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:26 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5024e3e5-228e-4594-bd94-0abcaf70de50 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5024e3e5-228e-4594-bd94-0abcaf70de50 tempest-VolumesActionsTest-1949287777 None] Detaching volume 0011ffb9-63ae-49f5-b2a3-1a22a603eca4 from instance 57c25ebc-3e74-4978-8f8a-c8151c318869.
Jun 29 04:58:27 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5024e3e5-228e-4594-bd94-0abcaf70de50 tempest-VolumesActionsTest-1949287777 None] Detach volume completed successfully.
Jun 29 04:58:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5024e3e5-228e-4594-bd94-0abcaf70de50 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:27 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af 1073741824" returned: 0 in 1.315s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:27 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af
Jun 29 04:58:27 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:28 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" returned: 0 in 0.952s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.815s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552333038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c50d22fc549e8b957d2ed78bc6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:20Z,use_quota=True,user_id='3b656a998cea45b580e949d825e2fc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Creating volume 6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:58:28 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc09e9a-b409-4aa6-be93-3f91575c0d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:28 devstack sudo[108965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c 1073741824
Jun 29 04:58:28 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed79380-c572-4cad-a34d-bc28fa8231cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:28 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af (8ec8d90e-e617-427d-b0ef-c67e9ae5d6af): created successfully
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed79380-c572-4cad-a34d-bc28fa8231cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (8eae6dc6-452b-4695-9405-9bf1bd155152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-03826e7b-7cb7-4d14-ab39-90b463c9c73d tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:29 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c 1073741824" returned: 0 in 1.338s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:29 devstack sudo[109014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c
Jun 29 04:58:29 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:30 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" returned: 0 in 0.816s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a23cd36-c274-4ebc-a858-0d3e3df7379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb4dd1c-7313-4959-ac53-88753907e44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:30 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Volume volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c (6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c): created successfully
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb4dd1c-7313-4959-ac53-88753907e44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:30 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Flow 'volume_create_manager' (79d92159-18f5-43f5-9fde-17d11f575a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ad865afd-a164-4c8a-a2c6-0b01b2ca21c5 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created volume successfully.
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[46550d29-de82-4c95-8042-c437e55d0e98]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:31 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c
Jun 29 04:58:31 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:32 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" returned: 0 in 0.944s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:32 devstack sudo[109027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c
Jun 29 04:58:32 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:32 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" returned: 0 in 0.773s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c" released by "delete_volume" :: held 1.768s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['a36c8ec5-fa12-448a-90b1-61890b939253', '7a89d9e0-e992-4895-bdec-21796ab42963', 'd8252da9-eedf-4cc4-8b93-1d9b4937cf11', '1ce168b4-3366-4edf-bdf0-eb0e87b943ae'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:33 devstack sudo[109031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:33 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[485d2c1c-3c5d-47a1-948e-01f8af6d8ad1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:33 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af
Jun 29 04:58:33 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:34 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.053s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:34 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9d4f7246-4863-449a-98bd-c27ef5483e8f tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-6c2363ff-56aa-4bd5-a6fc-afdb768e4b8c-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:34 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" returned: 0 in 1.166s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:34 devstack sudo[109042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af
Jun 29 04:58:34 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:35 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" returned: 0 in 0.762s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af" released by "delete_volume" :: held 2.003s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['be062ac0-3c9c-400e-a3c5-254e60666949', '9c8be1b2-5138-4e0c-8741-f58d3f65f048', '2e8f51ac-9517-45ef-ad16-529330940d05', '985a787a-987f-4ca2-8d93-ad3330488df4'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:35 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:35 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:36 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.704s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e6933e2b-94ec-495b-b0a4-53ff9a363847 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-8ec8d90e-e617-427d-b0ef-c67e9ae5d6af-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-2010f715-ba60-4b41-86e5-23b0f02664f5-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-2010f715-ba60-4b41-86e5-23b0f02664f5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:36 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-2010f715-ba60-4b41-86e5-23b0f02664f5" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2010f715-ba60-4b41-86e5-23b0f02664f5" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:37 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9cc983-41eb-4133-b60d-48e6d6b473c3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:37 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5
Jun 29 04:58:37 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:38 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5" returned: 0 in 1.036s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:38 devstack sudo[109057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5
Jun 29 04:58:38 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:39 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2010f715-ba60-4b41-86e5-23b0f02664f5" returned: 0 in 0.977s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2010f715-ba60-4b41-86e5-23b0f02664f5" released by "delete_volume" :: held 2.064s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['92b3ff3b-6c70-4eb4-bb66-1c10911cc36b', 'e55c0079-9cf3-4303-bd1e-e8a045b62dee', '4fdf0e85-fd45-4041-83fd-cc2ac391bf44', 'eed6fcfe-ba9e-4047-855b-5b035ca1bb73'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:39 devstack sudo[109061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:39 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:40 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.026s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0588112d-f30a-4fe1-a7fa-55b6335d9f49 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-2010f715-ba60-4b41-86e5-23b0f02664f5-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3583323e-2e88-4128-babf-4d81cb720d36]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:40 devstack sudo[109065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b4c2e-4848-44a6-96f4-9feba13e2d10]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:40 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:40 devstack sudo[109067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:58:40 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:41 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" returned: 0 in 0.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:41 devstack sudo[109073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053
Jun 29 04:58:41 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:41 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 1.047s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5084c805-9c57-4cf6-867a-4590b2fc1f92]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:41 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:58:41 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:42 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" returned: 0 in 0.666s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053" released by "delete_volume" :: held 1.672s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['6459d2ef-85de-4c67-8fb8-da4dffab14bf', 'b1f4616b-6781-47f6-bcdf-5c2cdbc66bd9', '18d11347-b579-42c2-ac62-263ce179c16c', '72a5533a-d35a-4a0b-b57e-c7ea69aabc6c'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:42 devstack sudo[109081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:42 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-7c16249e-b5c9-4b71-af01-2fb5b480e70f-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-7c16249e-b5c9-4b71-af01-2fb5b480e70f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:42 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.921s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.469dbe84-cd20-47e6-933f-64a16f678e38pl3o51_b.img {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-7c16249e-b5c9-4b71-af01-2fb5b480e70f" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:42 devstack sudo[109086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.469dbe84-cd20-47e6-933f-64a16f678e38pl3o51_b.img
Jun 29 04:58:42 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-7c16249e-b5c9-4b71-af01-2fb5b480e70f" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e3a07-719e-4bda-8069-75c13bc20f16]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:42 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f
Jun 29 04:58:42 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:43 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.788s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:43 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77dd3573-d669-4edb-82f1-3c275030c307 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-f4225901-6d6c-4eaf-aacf-c3e4e6cb3053-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:43 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f" returned: 0 in 1.204s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:44 devstack sudo[109106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f
Jun 29 04:58:44 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:45 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-7c16249e-b5c9-4b71-af01-2fb5b480e70f" returned: 0 in 1.558s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-7c16249e-b5c9-4b71-af01-2fb5b480e70f" released by "delete_volume" :: held 2.847s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['066f2b30-7da4-4ba1-a97c-3f5a1e274061', '36fda3d9-4bd1-48ce-a19b-9373e72c9ec0', '538ef351-944a-4eca-8947-53464b9cba0d', '0a856b4b-c7a2-4e97-920d-8cbc71bbebf2'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:46 devstack sudo[109110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:46 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-539765e9-2e52-405e-b624-c1b741e5d4df-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-539765e9-2e52-405e-b624-c1b741e5d4df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-539765e9-2e52-405e-b624-c1b741e5d4df" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-539765e9-2e52-405e-b624-c1b741e5d4df" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleting offline snapshot 539765e9-2e52-405e-b624-c1b741e5d4df of volume 2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] snapshot_file for this snap is: volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede732dd-1b95-4d22-9df4-c7e7dd3fba16]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:46 devstack sudo[109112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df
Jun 29 04:58:46 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:47 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:47 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-741d90ff-846f-48e9-990c-d4aa87cdfca4 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-7c16249e-b5c9-4b71-af01-2fb5b480e70f-delete_volume" released by "delete_volume" :: held 5.099s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:48 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:48 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.469dbe84-cd20-47e6-933f-64a16f678e38pl3o51_b.img" returned: 0 in 6.020s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df" returned: 0 in 2.057s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f144f05-6507-4e4c-94cf-282d740b33ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2013c88-8f64-45fd-bc58-93d8dab8f59d]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e061e-8f70-4b56-b27a-9cefe5032e2d]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:48 devstack sudo[109124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:58:48 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:48 devstack sudo[109125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea
Jun 29 04:58:48 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:49 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea" returned: 0 in 0.815s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:49 devstack sudo[109133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df
Jun 29 04:58:49 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:49 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 1.034s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:49 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.469dbe84-cd20-47e6-933f-64a16f678e38pl3o51_b.img {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:58:49 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Converted 1024.00 MB image at 170.08 MB/s
Jun 29 04:58:49 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] 469dbe84-cd20-47e6-933f-64a16f678e38 was raw, no need to convert to raw {{(pid=93723) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 29 04:58:50 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:50 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df
Jun 29 04:58:50 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:51 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea.539765e9-2e52-405e-b624-c1b741e5d4df" returned: 0 in 0.753s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-539765e9-2e52-405e-b624-c1b741e5d4df" released by "_delete_snapshot" :: held 4.706s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" released by "delete_snapshot" :: held 4.739s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['4af2effa-01f6-4ec2-b00f-db54fdd7e4b3', '3c57df9f-92d1-42bd-b328-debfc4427c54', 'b5cbf5a3-ed99-4e75-8a9d-18f1b8ff45e9', 'e03c0e20-11a0-40dd-993f-3680f77db008'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Delete snapshot completed successfully.
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5d265267-5e44-4d8b-bb3d-8ef84462a38a tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-539765e9-2e52-405e-b624-c1b741e5d4df-delete_snapshot" released by "delete_snapshot" :: held 4.993s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-2f144f05-6507-4e4c-94cf-282d740b33ea-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-2f144f05-6507-4e4c-94cf-282d740b33ea-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:58:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:58:52 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[36895c1a-1c5a-4925-a8c1-a3369b453486]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:58:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:52 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea
Jun 29 04:58:52 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:53 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea" returned: 0 in 0.913s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:53 devstack sudo[109150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea
Jun 29 04:58:53 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:53 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2f144f05-6507-4e4c-94cf-282d740b33ea" returned: 0 in 0.949s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-quobyte-2f144f05-6507-4e4c-94cf-282d740b33ea" released by "delete_volume" :: held 1.982s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Created reservations ['a431fced-bc26-4f76-9fad-b720c730ba0c', '83c4e963-e10c-427a-892e-a63dcb059b05', '590471f6-8021-4be8-b0e4-62ad3ac7423d', 'd07afc3b-511e-4c28-b322-b2a9e04f0a49'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:58:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:58:54 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:58:54 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:58:55 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Jun 29 04:58:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.910s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:58:55 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:58:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Deleted volume successfully.
Jun 29 04:58:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665196a0-0ebe-48f7-88b2-488e8064dbc3 tempest-CreateVolumesFromSnapshotTest-1060782269 None] Lock "cinder-2f144f05-6507-4e4c-94cf-282d740b33ea-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (5034b631-9a41-4349-9c5e-f216bb1d5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82ff9f0-58be-474e-8c5f-5cbb9c643783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82ff9f0-58be-474e-8c5f-5cbb9c643783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405361008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7dd292-d10b-46ea-8996-2ac6d66a69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:59Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea86bdb-dd28-4f32-8f52-8f86a55a6879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea86bdb-dd28-4f32-8f52-8f86a55a6879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa23e40-591a-49b1-bc81-04af54322924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa23e40-591a-49b1-bc81-04af54322924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7dd292-d10b-46ea-8996-2ac6d66a69b8', 'volume_name': 'volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36dba2a-4cd4-4813-ae11-b36f7a2131a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36dba2a-4cd4-4813-ae11-b36f7a2131a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930cff0-502b-4b64-b5ff-6b06335bfd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:58:59 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume 3c7dd292-d10b-46ea-8996-2ac6d66a69b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8', 'volume_size': 1}
Jun 29 04:58:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:03 devstack sudo[109157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:03 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:04 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 04:59:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 04:59:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 04:59:09 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=85,cinder:INSERT=22,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:59:09 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=78,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.267s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Uploaded volume to glance image-id: 469dbe84-cd20-47e6-933f-64a16f678e38. {{(pid=93723) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.368s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405361008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7dd292-d10b-46ea-8996-2ac6d66a69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:58:59Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume 3c7dd292-d10b-46ea-8996-2ac6d66a69b8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:12 devstack sudo[109198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 1073741824
Jun 29 04:59:12 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1208ed06-3253-42a5-8b68-9cb1838827a8 tempest-VolumesActionsTest-1949287777 None] Copy volume to image completed successfully.
Jun 29 04:59:13 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 1073741824" returned: 0 in 0.925s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:13 devstack sudo[109207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8
Jun 29 04:59:13 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:14 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" returned: 0 in 0.661s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.227s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930cff0-502b-4b64-b5ff-6b06335bfd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d62b95e-3024-44f0-81cf-2d2643aa5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8930f81-5a15-4bfd-ac66-7be7b8c8f7cd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 (3c7dd292-d10b-46ea-8996-2ac6d66a69b8): created successfully
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d62b95e-3024-44f0-81cf-2d2643aa5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (5034b631-9a41-4349-9c5e-f216bb1d5995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-88515934-04cb-45bf-bdc8-8a0fcfac03ef tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:14 devstack sudo[109210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:59:14 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:15 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.838s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:15 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a4386-2eba-4ada-aedb-4bdb33f789e9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:15 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:59:15 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (3bc3ccdb-262a-4ded-ab10-7b2c6c804cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86660b5-c9a8-478f-a73f-35bf1420596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86660b5-c9a8-478f-a73f-35bf1420596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781599544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19c133-fab0-4af3-886b-eb07ce542481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:16Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b6d641-77a5-4aa9-aa07-48307d708151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b6d641-77a5-4aa9-aa07-48307d708151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cc40c9-8d99-47c9-aee4-bab15b046166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cc40c9-8d99-47c9-aee4-bab15b046166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b19c133-fab0-4af3-886b-eb07ce542481', 'volume_name': 'volume-3b19c133-fab0-4af3-886b-eb07ce542481', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b81d1b-6f5c-4d18-8b08-ca40bdc77a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b81d1b-6f5c-4d18-8b08-ca40bdc77a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e966d4-6cca-408c-b0f2-0af2297b9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume 3b19c133-fab0-4af3-886b-eb07ce542481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b19c133-fab0-4af3-886b-eb07ce542481', 'volume_size': 1}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.835s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:16 devstack sudo[109221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img
Jun 29 04:59:16 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (93d9ca7b-f639-4a76-b22f-3f5f659ce5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4f4245-d638-43c2-8031-55a630d4981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4f4245-d638-43c2-8031-55a630d4981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567747059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:16Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22de3d19-c1c1-43b0-a177-6bd6112736bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22de3d19-c1c1-43b0-a177-6bd6112736bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c4f1d6-9964-4a38-80e2-89d4f476ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c4f1d6-9964-4a38-80e2-89d4f476ad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf', 'volume_name': 'volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42500ecb-f4a3-44b4-ae2a-0a8092305017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42500ecb-f4a3-44b4-ae2a-0a8092305017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f728c66e-90aa-4a11-9e22-d3e4b4e56147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume 41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf', 'volume_size': 1}
Jun 29 04:59:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (248edb48-6d3b-43ba-883b-b7300f023e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d629b6b9-9aa0-4d2b-9121-aec3a0d36a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d629b6b9-9aa0-4d2b-9121-aec3a0d36a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825061008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bbe389-d58b-4902-854b-9de0a6162759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:17Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a6da3-33a6-4a2e-8e58-394010bfba6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a6da3-33a6-4a2e-8e58-394010bfba6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c184614e-bf3a-4138-8901-3f3e6dff251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c184614e-bf3a-4138-8901-3f3e6dff251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bbe389-d58b-4902-854b-9de0a6162759', 'volume_name': 'volume-57bbe389-d58b-4902-854b-9de0a6162759', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4f71a0-2404-48aa-8db8-909fdd5bd025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4f71a0-2404-48aa-8db8-909fdd5bd025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751299a-f76c-41cc-94d9-ef248382f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:17 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume 57bbe389-d58b-4902-854b-9de0a6162759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bbe389-d58b-4902-854b-9de0a6162759', 'volume_size': 1}
Jun 29 04:59:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (b216ef76-4947-4bc0-857e-5f0344a74a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0f0969-97c4-476d-8190-c9d31b24d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0f0969-97c4-476d-8190-c9d31b24d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416225159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e33573e-e248-480f-91d2-09efde4ab29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:18Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caa2010-b1a4-4906-8e9c-63459f3ed516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caa2010-b1a4-4906-8e9c-63459f3ed516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1798a186-10cb-49bc-b4a4-1e54ca6697c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1798a186-10cb-49bc-b4a4-1e54ca6697c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e33573e-e248-480f-91d2-09efde4ab29d', 'volume_name': 'volume-2e33573e-e248-480f-91d2-09efde4ab29d', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343fba93-cbda-402a-b4c1-3bc337407825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343fba93-cbda-402a-b4c1-3bc337407825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db7f7f2-45a3-42b9-80f8-ecd05436b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:18 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume 2e33573e-e248-480f-91d2-09efde4ab29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e33573e-e248-480f-91d2-09efde4ab29d', 'volume_size': 1}
Jun 29 04:59:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (1ec93e53-b57a-49b0-8749-a8e0e925e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbd5070-ec6f-470c-989c-89df8f7a2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbd5070-ec6f-470c-989c-89df8f7a2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031282992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a7d1a7-62fa-4e25-8442-2b03b030fa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:19Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa867ac-1c31-4608-8336-900f051f26d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa867ac-1c31-4608-8336-900f051f26d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e744193b-d1ab-49ce-812d-ee251091bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e744193b-d1ab-49ce-812d-ee251091bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a7d1a7-62fa-4e25-8442-2b03b030fa13', 'volume_name': 'volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac36b8cb-49de-4e2d-b643-ee01370c2942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac36b8cb-49de-4e2d-b643-ee01370c2942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19033c82-e1f1-4c42-9837-dd1dd77a8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:19 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume c1a7d1a7-62fa-4e25-8442-2b03b030fa13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13', 'volume_size': 1}
Jun 29 04:59:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:22 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img" returned: 0 in 5.987s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3828d9-f50a-4cfc-995e-f166df0f9bec]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:22 devstack sudo[109252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:59:22 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:23 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.951s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:23 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:59:23 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Converted 1024.00 MB image at 171.00 MB/s
Jun 29 04:59:23 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] 9f161eef-cfbc-4cf3-957d-d403a73073b8 was raw, converting to qcow2 {{(pid=93723) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 29 04:59:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906169e-7c32-444b-92e9-4cfdab2b1f21]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:23 devstack sudo[109258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img
Jun 29 04:59:23 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:24 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img" returned: 0 in 0.747s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:24 devstack sudo[109263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img
Jun 29 04:59:24 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:24 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img" returned: 1 in 0.734s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 04:59:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img /opt/stack/data/cinder/conversion/vol_upload_qlk067y2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:24 devstack sudo[109268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img /opt/stack/data/cinder/conversion/vol_upload_qlk067y2
Jun 29 04:59:24 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:25 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img /opt/stack/data/cinder/conversion/vol_upload_qlk067y2" returned: 0 in 0.691s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:25 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Image conversion details: src /opt/stack/data/cinder/conversion/0011ffb9-63ae-49f5-b2a3-1a22a603eca4.temp_image.9f161eef-cfbc-4cf3-957d-d403a73073b8x8c54_g_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qlk067y2 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 04:59:25 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 29 04:59:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1fd92a-acf5-446d-81cb-3ac653059659]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qlk067y2 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:25 devstack sudo[109273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qlk067y2
Jun 29 04:59:25 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:26 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qlk067y2" returned: 0 in 0.774s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.939s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Uploaded volume to glance image-id: 9f161eef-cfbc-4cf3-957d-d403a73073b8. {{(pid=93723) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.230s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781599544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19c133-fab0-4af3-886b-eb07ce542481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:16Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume 3b19c133-fab0-4af3-886b-eb07ce542481 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:27 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:27 devstack sudo[109282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 1073741824
Jun 29 04:59:27 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:27 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-13c2795b-d720-4b6a-a84e-0270494ac073 tempest-VolumesActionsTest-1949287777 None] Copy volume to image completed successfully.
Jun 29 04:59:28 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 1073741824" returned: 0 in 1.113s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:28 devstack sudo[109345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481
Jun 29 04:59:28 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "cinder-quobyte-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-quobyte-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" acquired by "delete_volume" :: waited 0.038s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880e790-df45-42e1-881d-617a4f4cd107]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:29 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:59:29 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:29 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481" returned: 0 in 1.070s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.146s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567747059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:16Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume 41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:29 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e966d4-6cca-408c-b0f2-0af2297b9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b19c133-fab0-4af3-886b-eb07ce542481', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:29 devstack sudo[109372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf 1073741824
Jun 29 04:59:29 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c260146-0f66-4a17-8c66-9715fd0975a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:29 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-3b19c133-fab0-4af3-886b-eb07ce542481 (3b19c133-fab0-4af3-886b-eb07ce542481): created successfully
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c260146-0f66-4a17-8c66-9715fd0975a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:29 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (3bc3ccdb-262a-4ded-ab10-7b2c6c804cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:29 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9f8cd8c8-6705-4ab4-85bf-e254cba81115 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:30 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 1.034s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:30 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4
Jun 29 04:59:30 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:30 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf 1073741824" returned: 0 in 0.996s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:30 devstack sudo[109385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf
Jun 29 04:59:30 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:31 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" returned: 0 in 0.800s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-quobyte-0011ffb9-63ae-49f5-b2a3-1a22a603eca4" released by "delete_volume" :: held 1.955s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Created reservations ['7e2f2c68-8706-4664-9f2e-904abcf203ea', '66cb9062-5416-40b2-806f-7ba5709faf97', '81944870-c54e-439a-b418-3dbe5e29a2c6', '1af1d9d1-3f25-48a6-9c74-d509dc1a24eb'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:31 devstack sudo[109388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:31 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:31 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" returned: 0 in 1.010s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.073s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825061008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bbe389-d58b-4902-854b-9de0a6162759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:17Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume 57bbe389-d58b-4902-854b-9de0a6162759 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:31 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f728c66e-90aa-4a11-9e22-d3e4b4e56147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33a583-0471-413b-809d-c60a8eea495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:31 devstack sudo[109391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 1073741824
Jun 29 04:59:31 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:31 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf (41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf): created successfully
Jun 29 04:59:31 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33a583-0471-413b-809d-c60a8eea495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:32 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (93d9ca7b-f639-4a76-b22f-3f5f659ce5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:32 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fab101b6-7a1c-42bd-bc09-4d9e7a0c7ee5 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:32 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.952s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:32 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:32 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Deleted volume successfully.
Jun 29 04:59:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-665d8e16-8951-403f-a753-0af6f6d5a0b6 tempest-VolumesActionsTest-1949287777 None] Lock "cinder-0011ffb9-63ae-49f5-b2a3-1a22a603eca4-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 1073741824" returned: 0 in 1.398s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:33 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:33 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759
Jun 29 04:59:33 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:34 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759" returned: 0 in 0.829s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.311s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416225159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e33573e-e248-480f-91d2-09efde4ab29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:18Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume 2e33573e-e248-480f-91d2-09efde4ab29d {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:34 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751299a-f76c-41cc-94d9-ef248382f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bbe389-d58b-4902-854b-9de0a6162759', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:34 devstack sudo[109402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d 1073741824
Jun 29 04:59:34 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab7d4c6-6c25-4c9f-97ff-61cfeb2b95fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:34 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-57bbe389-d58b-4902-854b-9de0a6162759 (57bbe389-d58b-4902-854b-9de0a6162759): created successfully
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab7d4c6-6c25-4c9f-97ff-61cfeb2b95fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (248edb48-6d3b-43ba-883b-b7300f023e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7900b588-cfec-4a69-a6d4-d1102a43e289 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:35 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d 1073741824" returned: 0 in 1.342s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:35 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d
Jun 29 04:59:35 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:36 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d" returned: 0 in 0.900s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.039s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031282992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a7d1a7-62fa-4e25-8442-2b03b030fa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c206c1939e82401ead0ba9f2bc4662ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:19Z,use_quota=True,user_id='c15a5df5329f4cba92fda78b8306b0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Creating volume c1a7d1a7-62fa-4e25-8442-2b03b030fa13 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:36 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:36 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 1073741824
Jun 29 04:59:36 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db7f7f2-45a3-42b9-80f8-ecd05436b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e33573e-e248-480f-91d2-09efde4ab29d', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf38da-5dbd-4845-a398-517c7e75b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:36 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-2e33573e-e248-480f-91d2-09efde4ab29d (2e33573e-e248-480f-91d2-09efde4ab29d): created successfully
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf38da-5dbd-4845-a398-517c7e75b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (b216ef76-4947-4bc0-857e-5f0344a74a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9dfb7b7e-58f4-4afa-8769-77f036ce227a tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:37 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 1073741824" returned: 0 in 1.107s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:37 devstack sudo[109429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13
Jun 29 04:59:37 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:38 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" returned: 0 in 0.695s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19033c82-e1f1-4c42-9837-dd1dd77a8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72779851-1739-442a-9c95-2a950cef19d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Volume volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 (c1a7d1a7-62fa-4e25-8442-2b03b030fa13): created successfully
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72779851-1739-442a-9c95-2a950cef19d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Flow 'volume_create_manager' (1ec93e53-b57a-49b0-8749-a8e0e925e969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5ec7055f-bf00-4878-880d-54b1db211375 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created volume successfully.
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Flow 'volume_create_manager' (7c74944a-d25c-40d0-8f3f-3b60f7792140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681d3651-49ac-4116-a1e9-b0bc9082a008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681d3651-49ac-4116-a1e9-b0bc9082a008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2000533230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d31a7c-0178-48a7-a6d7-817f30739aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d126419de1fb441ab84ca5f58bca0b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:39Z,use_quota=True,user_id='1b948c91c40944f88ff11ec20f4608fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347f181e-b32d-43d2-8e38-66f051a223ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347f181e-b32d-43d2-8e38-66f051a223ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a626dd-8a0a-4a53-9e5e-006f7cf1623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a626dd-8a0a-4a53-9e5e-006f7cf1623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d31a7c-0178-48a7-a6d7-817f30739aba', 'volume_name': 'volume-27d31a7c-0178-48a7-a6d7-817f30739aba', 'volume_size': 2}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c742a570-1b1d-4a6a-bd98-5283be9a957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c742a570-1b1d-4a6a-bd98-5283be9a957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f658c758-1572-44f3-af87-2075ee3ffa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Volume 27d31a7c-0178-48a7-a6d7-817f30739aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d31a7c-0178-48a7-a6d7-817f30739aba', 'volume_size': 2}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2000533230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d31a7c-0178-48a7-a6d7-817f30739aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d126419de1fb441ab84ca5f58bca0b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:39Z,use_quota=True,user_id='1b948c91c40944f88ff11ec20f4608fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Creating volume 27d31a7c-0178-48a7-a6d7-817f30739aba {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:39 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba 2147483648 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:39 devstack sudo[109432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba 2147483648
Jun 29 04:59:39 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-c1a7d1a7-62fa-4e25-8442-2b03b030fa13-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-c1a7d1a7-62fa-4e25-8442-2b03b030fa13-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b6a77-3e3f-4a77-88f4-109901bcf2f3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:39 devstack sudo[109434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13
Jun 29 04:59:39 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:40 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba 2147483648" returned: 0 in 1.010s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:40 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba
Jun 29 04:59:40 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:40 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" returned: 0 in 0.862s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:40 devstack sudo[109445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13
Jun 29 04:59:40 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:40 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba" returned: 0 in 0.684s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f658c758-1572-44f3-af87-2075ee3ffa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d31a7c-0178-48a7-a6d7-817f30739aba', 'volume_size': 2}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01234183-154b-4850-96ee-3deef016b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:40 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" returned: 0 in 0.679s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Volume volume-27d31a7c-0178-48a7-a6d7-817f30739aba (27d31a7c-0178-48a7-a6d7-817f30739aba): created successfully
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01234183-154b-4850-96ee-3deef016b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Flow 'volume_create_manager' (7c74944a-d25c-40d0-8f3f-3b60f7792140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-c1a7d1a7-62fa-4e25-8442-2b03b030fa13" released by "delete_volume" :: held 1.597s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-751a28ef-94f6-4bc6-9456-252d3b249112 tempest-VolumesCloneNegativeTest-1127689069 None] Created volume successfully.
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['1f50090d-c6f5-4ecc-beb7-d915ceb5de5a', '2fdd2d7a-89d4-47d4-a8b2-1d519210b6e8', '7591b36b-5672-40dc-8551-258062b536cc', '38333121-2399-441e-aa9d-6080781fe60d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:41 devstack sudo[109449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:41 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Acquiring lock "cinder-27d31a7c-0178-48a7-a6d7-817f30739aba-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "cinder-27d31a7c-0178-48a7-a6d7-817f30739aba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Acquiring lock "cinder-quobyte-27d31a7c-0178-48a7-a6d7-817f30739aba" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "cinder-quobyte-27d31a7c-0178-48a7-a6d7-817f30739aba" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e1db52-7afe-40f0-8b7b-3e2154877716]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:41 devstack sudo[109452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba
Jun 29 04:59:41 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-2e33573e-e248-480f-91d2-09efde4ab29d-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-2e33573e-e248-480f-91d2-09efde4ab29d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-2e33573e-e248-480f-91d2-09efde4ab29d" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-2e33573e-e248-480f-91d2-09efde4ab29d" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa03317-4f23-4275-8e9d-88cb82c1d51f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:41 devstack sudo[109454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d
Jun 29 04:59:41 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:42 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:42 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b9722e5d-2574-4c65-8336-6b53f3709598 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-c1a7d1a7-62fa-4e25-8442-2b03b030fa13-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:42 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:42 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba
Jun 29 04:59:42 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:42 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d" returned: 0 in 0.896s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:42 devstack sudo[109488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d
Jun 29 04:59:42 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:43 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-27d31a7c-0178-48a7-a6d7-817f30739aba" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "cinder-quobyte-27d31a7c-0178-48a7-a6d7-817f30739aba" released by "delete_volume" :: held 1.635s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Created reservations ['e33da0d5-921f-41c3-9bfc-f80cdb290d81', 'e7f9cf2e-74b5-4673-b156-52f2e11450bd', '48e20850-485c-488a-9db1-2583e42012f3', '3145ed6d-3cb7-45d3-b648-f3dacceb5102'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:43 devstack sudo[109491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:43 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:43 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-2e33573e-e248-480f-91d2-09efde4ab29d" returned: 0 in 0.689s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-2e33573e-e248-480f-91d2-09efde4ab29d" released by "delete_volume" :: held 1.645s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['247d5aeb-d49e-4661-b201-178bdcfde25e', 'b8411bc4-cc51-4e54-a053-0c6980b2abfc', 'e7f91744-0fde-4630-a690-0e526ecfb343', '490a11d3-53f5-4fb2-a2a4-05cedaabefb3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:43 devstack sudo[109494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:43 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:43 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.676s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Deleted volume successfully.
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-486328d8-dbf5-4f3a-a3eb-d75a4b458799 tempest-VolumesCloneNegativeTest-1127689069 None] Lock "cinder-27d31a7c-0178-48a7-a6d7-817f30739aba-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-57bbe389-d58b-4902-854b-9de0a6162759-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-57bbe389-d58b-4902-854b-9de0a6162759-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-57bbe389-d58b-4902-854b-9de0a6162759" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-57bbe389-d58b-4902-854b-9de0a6162759" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03ca0a3-4d9c-4e99-b8ac-38b89c72a893]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:44 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.735s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:44 devstack sudo[109500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759
Jun 29 04:59:44 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4357c8ad-c7a1-40fd-80f1-ca7fa19bd64d tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-2e33573e-e248-480f-91d2-09efde4ab29d-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:44 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759" returned: 0 in 0.844s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:44 devstack sudo[109506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759
Jun 29 04:59:44 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:45 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-57bbe389-d58b-4902-854b-9de0a6162759" returned: 0 in 0.681s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-57bbe389-d58b-4902-854b-9de0a6162759" released by "delete_volume" :: held 1.572s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['4a81c4b4-bcd8-484a-a5a6-c4141fe8c186', 'fed583bb-f000-4147-98e1-991aba0887bd', '87352407-6b03-4e69-8812-ac20bb3e35e7', '532b8d7d-98d2-4426-9702-f14ac4ca5303'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:45 devstack sudo[109510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:45 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[338bf52e-3d0a-417c-92ca-b97d8f3271a8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:46 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.675s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4ca8f765-d140-4018-a074-b7999c0e76df tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-57bbe389-d58b-4902-854b-9de0a6162759-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:46 devstack sudo[109513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf
Jun 29 04:59:46 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:47 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" returned: 0 in 0.777s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:47 devstack sudo[109518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf
Jun 29 04:59:47 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:47 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" returned: 0 in 0.745s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf" released by "delete_volume" :: held 1.568s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:47 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['207375d6-f7b4-424d-97d3-b7c3e18863a2', '99524205-79db-48ff-88fe-9bfd96b365ac', '791eb228-f708-404e-9927-0baf13a499aa', '812b1def-71ad-4e0a-89bd-706116409d8c'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:48 devstack sudo[109527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:48 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-3b19c133-fab0-4af3-886b-eb07ce542481-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-3b19c133-fab0-4af3-886b-eb07ce542481-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-3b19c133-fab0-4af3-886b-eb07ce542481" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-3b19c133-fab0-4af3-886b-eb07ce542481" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2ab9a-70fc-4765-8c88-8ef4767f33d5]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:48 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:48 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1f269be6-7601-45e7-9448-debe2b2aabce tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-41c67bbb-5d27-4f15-b9c0-fdfbfbb763bf-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:48 devstack sudo[109530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481
Jun 29 04:59:48 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Flow 'volume_create_manager' (2003c6c0-2fa5-40f3-ad74-06c8695b3193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d94d740-c48f-4d71-9b83-6f5ecd96d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d94d740-c48f-4d71-9b83-6f5ecd96d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-379481065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188f934-3eae-44b1-9cff-5953b0f71535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8285df9cd8474db2f00a6b3e1a575c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:49Z,use_quota=True,user_id='8a3d9e54f9074bcbb70d05d0b8bc00a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fac63cc-3fae-4800-bf1c-caf2a09d6927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fac63cc-3fae-4800-bf1c-caf2a09d6927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e51229-59cf-4145-9772-990bdddb7ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e51229-59cf-4145-9772-990bdddb7ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3188f934-3eae-44b1-9cff-5953b0f71535', 'volume_name': 'volume-3188f934-3eae-44b1-9cff-5953b0f71535', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c873912-ed61-466f-bea8-d8434ed8a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c873912-ed61-466f-bea8-d8434ed8a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7997490b-5a38-40d3-834c-fcd5021a5eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:49 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Volume 3188f934-3eae-44b1-9cff-5953b0f71535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3188f934-3eae-44b1-9cff-5953b0f71535', 'volume_size': 1}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-379481065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188f934-3eae-44b1-9cff-5953b0f71535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8285df9cd8474db2f00a6b3e1a575c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:49Z,use_quota=True,user_id='8a3d9e54f9074bcbb70d05d0b8bc00a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Creating volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:49 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:49 devstack sudo[109532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 1073741824
Jun 29 04:59:49 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:49 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481" returned: 0 in 0.792s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:49 devstack sudo[109537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481
Jun 29 04:59:49 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:49 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 1073741824" returned: 0 in 0.807s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:50 devstack sudo[109543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535
Jun 29 04:59:50 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:50 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3b19c133-fab0-4af3-886b-eb07ce542481" returned: 0 in 0.666s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-3b19c133-fab0-4af3-886b-eb07ce542481" released by "delete_volume" :: held 1.509s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['3f3a7c8b-d664-4be8-af66-6ccf5292db5a', 'd42b8afc-160d-485b-88e7-12156c5b62dd', 'f7d64f07-5a8b-488b-b342-22039556a74a', '00bb057c-cef2-4534-8a2d-a0fe3adcb631'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:50 devstack sudo[109545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:50 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:50 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535" returned: 0 in 0.725s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7997490b-5a38-40d3-834c-fcd5021a5eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3188f934-3eae-44b1-9cff-5953b0f71535', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc00707-7abb-4bbb-816f-47df83f1700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Volume volume-3188f934-3eae-44b1-9cff-5953b0f71535 (3188f934-3eae-44b1-9cff-5953b0f71535): created successfully
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc00707-7abb-4bbb-816f-47df83f1700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Flow 'volume_create_manager' (2003c6c0-2fa5-40f3-ad74-06c8695b3193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-3c7dd292-d10b-46ea-8996-2ac6d66a69b8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-afe5201a-fb65-487e-bfe2-5c0f250d1421 tempest-VolumesSnapshotListTestJSON-677862176 None] Created volume successfully.
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-3c7dd292-d10b-46ea-8996-2ac6d66a69b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "cinder-quobyte-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[849b765c-5d16-4d5d-9117-bfe333b5880f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:50 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.711s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:50 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-41e7fdf1-7696-4ad4-9b41-faaa23108fd9 tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-3b19c133-fab0-4af3-886b-eb07ce542481-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:51 devstack sudo[109549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8
Jun 29 04:59:51 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Creating offline snapshot 1314971c-4c46-4500-b9b3-632e7b963afd of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e72f9f-5ded-4046-a6ec-5a7023037acc]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:51 devstack sudo[109551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535
Jun 29 04:59:51 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:51 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" returned: 0 in 0.842s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:51 devstack sudo[109556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8
Jun 29 04:59:51 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:52 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535" returned: 0 in 0.840s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:52 devstack sudo[109562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd 1G
Jun 29 04:59:52 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:52 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" returned: 0 in 0.667s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-quobyte-3c7dd292-d10b-46ea-8996-2ac6d66a69b8" released by "delete_volume" :: held 1.562s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Created reservations ['9d383639-8a4d-4eea-ace0-c7966c4b77c2', 'da3877de-01b1-4278-8f83-48516d91030c', '918fe2c0-e940-4071-ae6b-81588cb8292c', 'a7c28b16-db6b-41d0-a694-f75ce869c229'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:52 devstack sudo[109565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 04:59:52 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:53 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd 1G" returned: 0 in 0.821s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:53 devstack sudo[109570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 04:59:53 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:53 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.701s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 04:59:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Deleted volume successfully.
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-735d69ea-9fa0-4986-8c93-05b5fd4ff0ca tempest-CreateVolumesFromSourceVolumeTest-1544243791 None] Lock "cinder-3c7dd292-d10b-46ea-8996-2ac6d66a69b8-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 04:59:53 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.802s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:53 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd is being set with open permissions: ugo+rw
Jun 29 04:59:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:53 devstack sudo[109579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 04:59:53 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:54 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.726s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:54 devstack sudo[109582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info
Jun 29 04:59:54 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Flow 'volume_create_manager' (d3e4163b-fd67-47c4-867d-8601264b357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502f1dba-374e-433f-8f82-c4c28c2cc9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502f1dba-374e-433f-8f82-c4c28c2cc9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-427285718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eeecb0-338f-4f71-8a12-f2c92608d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870af4eeced84fafb251554c2da7efa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:55Z,use_quota=True,user_id='dba790b93dbf425db9e188c9071e3ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0664d7-c886-4a6e-a253-37b23189b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0664d7-c886-4a6e-a253-37b23189b99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aa7370-d40c-4d30-9912-85fadd198322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aa7370-d40c-4d30-9912-85fadd198322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29eeecb0-338f-4f71-8a12-f2c92608d846', 'volume_name': 'volume-29eeecb0-338f-4f71-8a12-f2c92608d846', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319649d4-2616-4964-a989-86a4f36a713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319649d4-2616-4964-a989-86a4f36a713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e275c8-30be-415d-a92e-cbf941e99876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Volume 29eeecb0-338f-4f71-8a12-f2c92608d846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29eeecb0-338f-4f71-8a12-f2c92608d846', 'volume_size': 1}
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:55 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info" returned: 0 in 0.724s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:55 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info is being set with open permissions: ugo+rw
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:55 devstack sudo[109585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info
Jun 29 04:59:55 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:55 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.info" returned: 0 in 0.657s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.671s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-427285718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eeecb0-338f-4f71-8a12-f2c92608d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870af4eeced84fafb251554c2da7efa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:55Z,use_quota=True,user_id='dba790b93dbf425db9e188c9071e3ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Creating volume 29eeecb0-338f-4f71-8a12-f2c92608d846 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 04:59:56 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:56 devstack sudo[109589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 1073741824
Jun 29 04:59:56 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a01be0de-712a-4f8a-bef2-8cfdb9fb48af tempest-VolumesSnapshotListTestJSON-677862176 None] Create snapshot completed successfully
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 04:59:56 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 1073741824" returned: 0 in 0.945s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:57 devstack sudo[109594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846
Jun 29 04:59:57 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:57 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846" returned: 0 in 0.675s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Creating offline snapshot 34fbd70a-edfe-4bfd-ae5b-9f075044d58d of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e275c8-30be-415d-a92e-cbf941e99876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29eeecb0-338f-4f71-8a12-f2c92608d846', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19fe41f-5b3f-4fee-89db-5bac2558ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0a5bb-4764-4485-94e6-35f3daa2941f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:57 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Volume volume-29eeecb0-338f-4f71-8a12-f2c92608d846 (29eeecb0-338f-4f71-8a12-f2c92608d846): created successfully
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19fe41f-5b3f-4fee-89db-5bac2558ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:57 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Flow 'volume_create_manager' (d3e4163b-fd67-47c4-867d-8601264b357a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4d102234-0865-464b-bb39-c7b3a5491df3 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Created volume successfully.
Jun 29 04:59:57 devstack sudo[109597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 04:59:57 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Flow 'volume_create_manager' (522ea9f1-2a64-458d-b7b9-b3ecb7604fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d5afb8-a74f-42d9-bb1c-442ed6530c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d5afb8-a74f-42d9-bb1c-442ed6530c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebfd19a-b301-4bf0-89d9-58166c22596a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc5732013547cebbb95cd3375c56d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:58Z,use_quota=True,user_id='d7a87e9f0c5e448caa13928f63db54eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5d5390-7a3b-4f68-a94f-ec255e95c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5d5390-7a3b-4f68-a94f-ec255e95c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5416f0b8-938a-4401-b654-90b0c87f036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 04:59:58 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.827s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:58 devstack sudo[109605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d 1G
Jun 29 04:59:58 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5416f0b8-938a-4401-b654-90b0c87f036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ebfd19a-b301-4bf0-89d9-58166c22596a', 'volume_name': 'volume-1ebfd19a-b301-4bf0-89d9-58166c22596a', 'volume_size': 1, 'image_id': '1a9d4983-9398-442d-a016-f74357206b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec15d4747e289a02c69d06079f2364a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc5732013547cebbb95cd3375c56d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e4a509cd6defdda6d3a7998b56cc685af3a1db5c0cb1920e805809b423cc0289460f021f84ac137df7137d4c7a42fb621ed79e36f272618ec00e708120590908', 'id': '1a9d4983-9398-442d-a016-f74357206b78', 'created_at': datetime.datetime(2026, 6, 29, 2, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 59, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9d4983-9398-442d-a016-f74357206b78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8731607a0>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496a7af3-13ec-4048-ab3b-8832c97add82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496a7af3-13ec-4048-ab3b-8832c97add82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2914e1-431a-437f-a5c6-b96abdb50db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 04:59:58 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Volume 1ebfd19a-b301-4bf0-89d9-58166c22596a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ebfd19a-b301-4bf0-89d9-58166c22596a', 'volume_size': 1, 'image_id': '1a9d4983-9398-442d-a016-f74357206b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec15d4747e289a02c69d06079f2364a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc5732013547cebbb95cd3375c56d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e4a509cd6defdda6d3a7998b56cc685af3a1db5c0cb1920e805809b423cc0289460f021f84ac137df7137d4c7a42fb621ed79e36f272618ec00e708120590908', 'id': '1a9d4983-9398-442d-a016-f74357206b78', 'created_at': datetime.datetime(2026, 6, 29, 2, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 59, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9d4983-9398-442d-a016-f74357206b78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8731607a0>}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Trying to clone 1ebfd19a-b301-4bf0-89d9-58166c22596a from image 1a9d4983-9398-442d-a016-f74357206b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 04:59:58 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Image download 0.00 MB at 0.00 MB/s
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[32645276-4fce-4ff5-a18b-a6da5cd35631]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 04:59:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:59 devstack sudo[109607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 04:59:59 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:59 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d 1G" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:59 devstack sudo[109612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 04:59:59 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 04:59:59 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root
Jun 29 04:59:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 04:59:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 04:59:59 devstack sudo[109616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 04:59:59 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:00 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.748s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:00 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d is being set with open permissions: ugo+rw
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:00 devstack sudo[109621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:00 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:00 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Temporary image 1a9d4983-9398-442d-a016-f74357206b78 is fetched for user d7a87e9f0c5e448caa13928f63db54eb. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e72259d-00cf-4d93-bc36-b43733377441]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:00 devstack sudo[109626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 05:00:00 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:00 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.702s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.329s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a8f23946-d841-4c71-a964-8963829c4108 tempest-VolumesSnapshotListTestJSON-677862176 None] Create snapshot completed successfully
Jun 29 05:00:01 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:01 devstack sudo[109638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 05:00:01 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d80312-eed5-4bfe-8ac0-678c50b97af9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:01 devstack sudo[109641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846
Jun 29 05:00:01 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:02 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 1 in 0.783s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:02 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846" returned: 0 in 0.788s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T02:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebfd19a-b301-4bf0-89d9-58166c22596a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc5732013547cebbb95cd3375c56d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T02:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T02:59:58Z,use_quota=True,user_id='d7a87e9f0c5e448caa13928f63db54eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Creating volume 1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:02 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:02 devstack sudo[109649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1073741824
Jun 29 05:00:02 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-29eeecb0-338f-4f71-8a12-f2c92608d846', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c1aab89-67ca-4dd3-8330-2e9ecf562cf4', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 05:00:02 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-d0478eb6-226a-4803-86a6-41d22651f8bd req-89962e61-009b-4980-b2f4-95f9bacd9173 tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] attachment_update completed successfully.
Jun 29 05:00:03 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1073741824" returned: 0 in 0.828s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:03 devstack sudo[109724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:03 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:03 devstack sudo[110043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:03 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:03 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 0 in 0.697s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.669s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Creating offline snapshot ce32584f-4fa6-4e40-b813-08d65faff034 of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7163858-d703-4873-84a8-5592dc42b6f8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Attempting download of 1a9d4983-9398-442d-a016-f74357206b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}])) to volume 1ebfd19a-b301-4bf0-89d9-58166c22596a. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbe0df-3bd0-4192-be79-a32b82731840]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:04 devstack sudo[110048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:04 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:04 devstack sudo[110049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b
Jun 29 05:00:04 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:04 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.713s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:00:04 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b" returned: 0 in 0.733s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:04 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.845s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:04 devstack sudo[110059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 1G
Jun 29 05:00:04 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:04 devstack sudo[110058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b
Jun 29 05:00:04 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:05 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b" returned: 1 in 0.797s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9d4983-9398-442d-a016-f74357206b78_49evmr1b' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ff857-5e1f-4b4e-b079-114dc8aaa79a]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:05 devstack sudo[110067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 05:00:05 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:05 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 1G" returned: 0 in 0.915s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:05 devstack sudo[110071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034
Jun 29 05:00:05 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:06 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:06 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:06 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 is being set with open permissions: ugo+rw
Jun 29 05:00:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:06 devstack sudo[110079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034
Jun 29 05:00:06 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:06 devstack sudo[110078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD
Jun 29 05:00:06 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:07 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:07 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034" returned: 0 in 0.760s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] 1a9d4983-9398-442d-a016-f74357206b78 was raw, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:07 devstack sudo[110086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:07 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a3c06a59-245a-4e40-9579-b17cfaca4498 tempest-VolumesSnapshotListTestJSON-677862176 None] Create snapshot completed successfully
Jun 29 05:00:08 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 0 in 0.900s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a9d4983-9398-442d-a016-f74357206b78_r2n5czjfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:00:08 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Converted 0.00 MB image at 0.00 MB/s
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:08 devstack sudo[110091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1G
Jun 29 05:00:08 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-ce32584f-4fa6-4e40-b813-08d65faff034-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-ce32584f-4fa6-4e40-b813-08d65faff034-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-ce32584f-4fa6-4e40-b813-08d65faff034" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-ce32584f-4fa6-4e40-b813-08d65faff034" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Deleting offline snapshot ce32584f-4fa6-4e40-b813-08d65faff034 of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] snapshot_file for this snap is: volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2714dce2-1580-411d-b345-0e429022b707]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:08 devstack sudo[110093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034
Jun 29 05:00:08 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:08 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a 1G" returned: 0 in 0.706s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[227dcb4c-f4bd-4a9f-8e74-e488b4c20ef5]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:08 devstack sudo[110098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:08 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:09 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034" returned: 0 in 0.799s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c4ee4-d3ef-4cfa-83cb-39c51160b3fa]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-e0daa858-600d-4501-9c74-5e8875794843 req-f27d74e9-3ef0-4d42-a5ed-2301104c52fa tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Terminate volume connection completed successfully.
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-e0daa858-600d-4501-9c74-5e8875794843 req-f27d74e9-3ef0-4d42-a5ed-2301104c52fa tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Deleting attachment 4c1aab89-67ca-4dd3-8330-2e9ecf562cf4. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 05:00:09 devstack sudo[110133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:09 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:09 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 0 in 0.883s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:09 devstack sudo[110137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:09 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:10 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.841s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:10 devstack sudo[110142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034
Jun 29 05:00:10 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:10 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 1 in 0.794s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Downloaded image 1a9d4983-9398-442d-a016-f74357206b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}])) to volume 1ebfd19a-b301-4bf0-89d9-58166c22596a successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Temporary image 1a9d4983-9398-442d-a016-f74357206b78 for user d7a87e9f0c5e448caa13928f63db54eb is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Marking volume 1ebfd19a-b301-4bf0-89d9-58166c22596a as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=78,cinder:INSERT=21,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Copying metadata from image 1a9d4983-9398-442d-a016-f74357206b78 to 1ebfd19a-b301-4bf0-89d9-58166c22596a. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Creating volume glance metadata for volume 1ebfd19a-b301-4bf0-89d9-58166c22596a backed by image 1a9d4983-9398-442d-a016-f74357206b78 with: {'image_id': '1a9d4983-9398-442d-a016-f74357206b78', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eec15d4747e289a02c69d06079f2364a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=103,cinder:SELECT=78,cinder:DELETE=11,cinder:INSERT=23 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2914e1-431a-437f-a5c6-b96abdb50db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebfd19a-b301-4bf0-89d9-58166c22596a', 'volume_size': 1, 'image_id': '1a9d4983-9398-442d-a016-f74357206b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9d4983-9398-442d-a016-f74357206b78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eec15d4747e289a02c69d06079f2364a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc5732013547cebbb95cd3375c56d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e4a509cd6defdda6d3a7998b56cc685af3a1db5c0cb1920e805809b423cc0289460f021f84ac137df7137d4c7a42fb621ed79e36f272618ec00e708120590908', 'id': '1a9d4983-9398-442d-a016-f74357206b78', 'created_at': datetime.datetime(2026, 6, 29, 2, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 59, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9d4983-9398-442d-a016-f74357206b78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd8731607a0>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f13786-9f9e-4108-8eaa-9b66689b8530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Volume volume-1ebfd19a-b301-4bf0-89d9-58166c22596a (1ebfd19a-b301-4bf0-89d9-58166c22596a): created successfully
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f13786-9f9e-4108-8eaa-9b66689b8530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Flow 'volume_create_manager' (522ea9f1-2a64-458d-b7b9-b3ecb7604fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-af1cac83-af86-472a-8fd5-9120ed666d61 tempest-VolumeImageDependencyTests-2025310534 None] Created volume successfully.
Jun 29 05:00:10 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034" returned: 0 in 0.831s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:11 devstack sudo[110150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034
Jun 29 05:00:11 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "cinder-29eeecb0-338f-4f71-8a12-f2c92608d846-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "cinder-29eeecb0-338f-4f71-8a12-f2c92608d846-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Acquiring lock "cinder-1ebfd19a-b301-4bf0-89d9-58166c22596a-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "cinder-1ebfd19a-b301-4bf0-89d9-58166c22596a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "cinder-quobyte-29eeecb0-338f-4f71-8a12-f2c92608d846" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "cinder-quobyte-29eeecb0-338f-4f71-8a12-f2c92608d846" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Acquiring lock "cinder-quobyte-1ebfd19a-b301-4bf0-89d9-58166c22596a" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf7afc-bef3-45b2-8fe5-58cf49ec8092]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "cinder-quobyte-1ebfd19a-b301-4bf0-89d9-58166c22596a" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[58faddc3-208e-4e5b-9f9a-aafe34edf11d]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:11 devstack sudo[110152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846
Jun 29 05:00:11 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:11 devstack sudo[110153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:11 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:11 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.ce32584f-4fa6-4e40-b813-08d65faff034" returned: 0 in 0.739s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-ce32584f-4fa6-4e40-b813-08d65faff034" released by "_delete_snapshot" :: held 3.320s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" released by "delete_snapshot" :: held 3.340s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Created reservations ['0e1ed690-7a4c-4087-b843-2ee4392a7e2b', 'b39dc85c-e945-411b-9d3a-533a95979b08', '2c4af992-e867-455b-9bbb-4a33bc8573fd', '5c63f9fc-ec11-4802-a467-46632e5ed363'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Delete snapshot completed successfully.
Jun 29 05:00:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c63f8c30-28de-4d6c-b9af-1f3aec4ea27b tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-ce32584f-4fa6-4e40-b813-08d65faff034-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:12 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846" returned: 0 in 0.826s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:12 devstack sudo[110197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846
Jun 29 05:00:12 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:12 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 0 in 0.806s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:12 devstack sudo[110199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:12 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-34fbd70a-edfe-4bfd-ae5b-9f075044d58d-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-34fbd70a-edfe-4bfd-ae5b-9f075044d58d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-34fbd70a-edfe-4bfd-ae5b-9f075044d58d" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-34fbd70a-edfe-4bfd-ae5b-9f075044d58d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Deleting offline snapshot 34fbd70a-edfe-4bfd-ae5b-9f075044d58d of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] snapshot_file for this snap is: volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[25348350-fe80-4b84-b4de-48950b8b480f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:12 devstack sudo[110203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:12 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:12 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-29eeecb0-338f-4f71-8a12-f2c92608d846" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "cinder-quobyte-29eeecb0-338f-4f71-8a12-f2c92608d846" released by "delete_volume" :: held 1.602s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Created reservations ['5931e6f7-c679-4b03-b180-11bcb0f26d8d', 'e7386804-1ae6-4171-811d-0b17a518e809', '650a4ea1-fe99-4e62-aac4-74f1ccf1654d', '20f53797-34ba-4077-b8d6-53b07c854225'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:13 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 1 in 0.829s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:13 devstack sudo[110209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:13 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:13 devstack sudo[110210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a
Jun 29 05:00:13 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:13 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.814s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0def246-89e4-41fc-a7df-f96593c2a36e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:13 devstack sudo[110216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 05:00:13 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:13 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Deleted volume successfully.
Jun 29 05:00:13 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1ebfd19a-b301-4bf0-89d9-58166c22596a" returned: 0 in 0.748s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "cinder-quobyte-1ebfd19a-b301-4bf0-89d9-58166c22596a" released by "delete_volume" :: held 2.457s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3727b747-0365-43d7-b565-cafdb8ffdcdf tempest-TestServerVolumeAttachScenarioOldVersion-1362084584 None] Lock "cinder-29eeecb0-338f-4f71-8a12-f2c92608d846-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:13 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Created reservations ['56b1a1a3-515e-4d0f-bb30-920172755fa9', '3250a01e-6e05-4f1d-9dca-9184b6fc7411', '81ef0a41-2e8d-4700-ab09-008f685fbc16', '94c3b94b-fa56-41c6-827c-97ef4b6fbf77'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:14 devstack sudo[110220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:14 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:14 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.835s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:14 devstack sudo[110225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:14 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:14 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.765s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Deleted volume successfully.
Jun 29 05:00:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-717c5623-5892-474e-8845-219d68d1d327 tempest-VolumeImageDependencyTests-2025310534 None] Lock "cinder-1ebfd19a-b301-4bf0-89d9-58166c22596a-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:15 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 1.252s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:15 devstack sudo[110276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d
Jun 29 05:00:15 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:16 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.34fbd70a-edfe-4bfd-ae5b-9f075044d58d" returned: 0 in 0.736s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-34fbd70a-edfe-4bfd-ae5b-9f075044d58d" released by "_delete_snapshot" :: held 3.771s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" released by "delete_snapshot" :: held 3.795s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:16 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Created reservations ['4b8b5970-cfd5-462e-8f1b-8a312b50e707', 'fea665cf-e008-40b4-b766-d2f902d5f113', '2e38f1d9-aaa8-4239-aef6-b9e413b84c03', 'c87db6cc-ae6e-4cc7-bc0d-178691a5836b'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Delete snapshot completed successfully.
Jun 29 05:00:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-192bf94d-4daa-4252-8f89-584e82cd4ec2 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-34fbd70a-edfe-4bfd-ae5b-9f075044d58d-delete_snapshot" released by "delete_snapshot" :: held 4.045s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-1314971c-4c46-4500-b9b3-632e7b963afd-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-1314971c-4c46-4500-b9b3-632e7b963afd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-1314971c-4c46-4500-b9b3-632e7b963afd" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-1314971c-4c46-4500-b9b3-632e7b963afd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Deleting offline snapshot 1314971c-4c46-4500-b9b3-632e7b963afd of volume 3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] snapshot_file for this snap is: volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ee838-c938-449b-b2a6-697f6a7e9d6a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:17 devstack sudo[110283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 05:00:17 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:17 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.808s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3188f934-3eae-44b1-9cff-5953b0f71535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[df10f028-55c0-41c5-a513-3c0a5873a6d5]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:18 devstack sudo[110289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535
Jun 29 05:00:18 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:18 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535" returned: 0 in 0.775s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:18 devstack sudo[110294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 05:00:18 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:19 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:19 devstack sudo[110299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd
Jun 29 05:00:19 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:20 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535.1314971c-4c46-4500-b9b3-632e7b963afd" returned: 0 in 0.680s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-1314971c-4c46-4500-b9b3-632e7b963afd" released by "_delete_snapshot" :: held 3.145s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" released by "delete_snapshot" :: held 3.172s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:20 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Created reservations ['fd650cfe-c807-49e6-8775-c54d9228d6d5', '017b6309-4af8-4416-9459-35e626a7ac4a', 'ce39f97a-7290-499b-a168-38c5c88767f7', 'f9e0c3b7-3b41-44d4-9ad4-463f24344583'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Delete snapshot completed successfully.
Jun 29 05:00:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0dafe5fa-fc99-4754-b10e-13532505a81a tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-1314971c-4c46-4500-b9b3-632e7b963afd-delete_snapshot" released by "delete_snapshot" :: held 3.347s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-3188f934-3eae-44b1-9cff-5953b0f71535-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-3188f934-3eae-44b1-9cff-5953b0f71535-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f152e-3de7-4455-8424-923a56916df2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:21 devstack sudo[110302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535
Jun 29 05:00:21 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:22 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535" returned: 0 in 0.820s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:22 devstack sudo[110308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535
Jun 29 05:00:22 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:22 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3188f934-3eae-44b1-9cff-5953b0f71535" returned: 0 in 0.655s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-quobyte-3188f934-3eae-44b1-9cff-5953b0f71535" released by "delete_volume" :: held 1.540s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Created reservations ['b1c02c24-c751-44eb-9be8-1636a6eb29cb', '85ee53ea-1b4e-4ca5-ac75-7a82b1e5ee1a', '068e39df-002e-4142-acdc-4dbec2d80aef', '3db24f1e-d8ef-4f11-8a1b-68cd4338d667'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:23 devstack sudo[110311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:23 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:23 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Deleted volume successfully.
Jun 29 05:00:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e41e36e1-7b42-40db-9393-9d43be61f637 tempest-VolumesSnapshotListTestJSON-677862176 None] Lock "cinder-3188f934-3eae-44b1-9cff-5953b0f71535-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:26 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Flow 'volume_create_manager' (8a49c1ef-5488-4450-ba51-3430ba20b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:26 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0090a82d-6ba7-4dbf-9b39-9e57e618270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0090a82d-6ba7-4dbf-9b39-9e57e618270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532174432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e07fca-e95a-40d7-9d03-bd3544fac9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54044fb3d9c3476a820f50b5cb026c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:27Z,use_quota=True,user_id='d00d067d4c7c46d582fce89fbad66dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a048151e-aceb-45a7-bf70-bdc4928265c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a048151e-aceb-45a7-bf70-bdc4928265c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c4c7d-97d7-471c-bf53-deec27959a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c4c7d-97d7-471c-bf53-deec27959a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e07fca-e95a-40d7-9d03-bd3544fac9b4', 'volume_name': 'volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4', 'volume_size': 2}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d156a49b-0433-4f12-a061-36a3afe1c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d156a49b-0433-4f12-a061-36a3afe1c597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0daf89b-365c-4eb2-b376-4ed74e47cc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:27 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Volume 18e07fca-e95a-40d7-9d03-bd3544fac9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4', 'volume_size': 2}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532174432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e07fca-e95a-40d7-9d03-bd3544fac9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54044fb3d9c3476a820f50b5cb026c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:27Z,use_quota=True,user_id='d00d067d4c7c46d582fce89fbad66dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Creating volume 18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:27 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 2147483648 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:27 devstack sudo[110318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 2147483648
Jun 29 05:00:27 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:28 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 2147483648" returned: 0 in 0.959s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:28 devstack sudo[110325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4
Jun 29 05:00:28 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:28 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4" returned: 0 in 0.686s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0daf89b-365c-4eb2-b376-4ed74e47cc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4', 'volume_size': 2}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c10caf-1805-439b-92f1-3a135a31b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:28 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Volume volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 (18e07fca-e95a-40d7-9d03-bd3544fac9b4): created successfully
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c10caf-1805-439b-92f1-3a135a31b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:28 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Flow 'volume_create_manager' (8a49c1ef-5488-4450-ba51-3430ba20b167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d5f69b7f-7ef6-4c3f-a833-085e8048b036 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Created volume successfully.
Jun 29 05:00:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Creating offline snapshot 08f1a8f5-b554-4eeb-ac7d-6c9016521bee of volume 18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:00:29 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e2a13-6290-411f-8b85-ba0dedc95d2e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:29 devstack sudo[110328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4
Jun 29 05:00:29 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:30 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4" returned: 0 in 0.816s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee 2G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:30 devstack sudo[110334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee 2G
Jun 29 05:00:30 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:30 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee 2G" returned: 0 in 0.881s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:31 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee
Jun 29 05:00:31 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:31 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee" returned: 0 in 0.742s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:31 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee is being set with open permissions: ugo+rw
Jun 29 05:00:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:31 devstack sudo[110345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee
Jun 29 05:00:31 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:32 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee" returned: 0 in 0.662s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:32 devstack sudo[110348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info
Jun 29 05:00:32 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:33 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info" returned: 0 in 0.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:33 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info is being set with open permissions: ugo+rw
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:33 devstack sudo[110351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info
Jun 29 05:00:33 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (a6eef0fa-a09c-45c9-8fd8-0f6426ffeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe05d1a-8a75-4e6e-9d51-013eadeec7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe05d1a-8a75-4e6e-9d51-013eadeec7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803181709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df554096-8c7d-4c87-b412-b220ac9e10c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:33Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291aef8f-f6f5-4c92-a9be-f144e887fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291aef8f-f6f5-4c92-a9be-f144e887fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e746e5e1-2d77-4931-ad26-4a1e0a26c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e746e5e1-2d77-4931-ad26-4a1e0a26c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df554096-8c7d-4c87-b412-b220ac9e10c5', 'volume_name': 'volume-df554096-8c7d-4c87-b412-b220ac9e10c5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be9229a-9539-40dc-b69f-59f8663eef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be9229a-9539-40dc-b69f-59f8663eef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecca9f48-b2a5-4963-938b-c4bd8ceba295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Volume df554096-8c7d-4c87-b412-b220ac9e10c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df554096-8c7d-4c87-b412-b220ac9e10c5', 'volume_size': 1}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (a1c7e624-67e4-4283-8f10-7700698d0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039f43f7-f29a-4fc0-9c10-0d694bb2a63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039f43f7-f29a-4fc0-9c10-0d694bb2a63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144293799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee6f925-dfcd-4d3d-a880-d75bbdb229f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:33Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260093c-4256-4407-accf-a218860fa32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260093c-4256-4407-accf-a218860fa32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a980214-5deb-40db-b779-dd8fef633382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a980214-5deb-40db-b779-dd8fef633382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee6f925-dfcd-4d3d-a880-d75bbdb229f4', 'volume_name': 'volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edefe2e-eb24-472c-8d5b-62409068eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edefe2e-eb24-472c-8d5b-62409068eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9854c0c1-68af-4c96-a3f9-ce67906baf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Volume fee6f925-dfcd-4d3d-a880-d75bbdb229f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4', 'volume_size': 1}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:33 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.info" returned: 0 in 0.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803181709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df554096-8c7d-4c87-b412-b220ac9e10c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:33Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Creating volume df554096-8c7d-4c87-b412-b220ac9e10c5 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:33 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:33 devstack sudo[110354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 1073741824
Jun 29 05:00:33 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7aee5aa0-47a5-4415-a0dc-b6d4598ef85f tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Create snapshot completed successfully
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (6b4fe536-92e7-4980-97e4-c5713ccd0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8d9a2a-091b-4297-9199-749c8eef2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8d9a2a-091b-4297-9199-749c8eef2b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1896372549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:34Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b53f5b9-b932-426d-bcfd-8ff5d9dc0094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b53f5b9-b932-426d-bcfd-8ff5d9dc0094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ccb574-1b5f-4e43-8737-b224e573e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ccb574-1b5f-4e43-8737-b224e573e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4', 'volume_name': 'volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81cb841-142c-4511-a6af-385f73cb4315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81cb841-142c-4511-a6af-385f73cb4315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8148ec0-c170-465f-ab39-743f07db2768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Volume 82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4', 'volume_size': 1}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (f57a28ca-dcea-4676-a8ee-894a67b894af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8816c1a-a06c-4d73-be75-5aecb5d35cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8816c1a-a06c-4d73-be75-5aecb5d35cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1365711338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e458f-7fc6-438d-be5e-60806d839a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:34Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e04d5bf-3375-430a-94d5-d467751b4b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e04d5bf-3375-430a-94d5-d467751b4b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c55607-6ecb-4a79-945c-67eaa63e90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c55607-6ecb-4a79-945c-67eaa63e90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1e458f-7fc6-438d-be5e-60806d839a60', 'volume_name': 'volume-3a1e458f-7fc6-438d-be5e-60806d839a60', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51e4de0-503d-4683-a57c-e58cc2f555cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51e4de0-503d-4683-a57c-e58cc2f555cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b815a99-2211-4b99-81c0-6a7967111846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Volume 3a1e458f-7fc6-438d-be5e-60806d839a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1e458f-7fc6-438d-be5e-60806d839a60', 'volume_size': 1}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "cinder-08f1a8f5-b554-4eeb-ac7d-6c9016521bee-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-08f1a8f5-b554-4eeb-ac7d-6c9016521bee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (92ca172f-a472-49ed-9718-cb33a8d2cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a374d4-b081-4df5-9638-920fb51000c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "cinder-quobyte-08f1a8f5-b554-4eeb-ac7d-6c9016521bee" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a374d4-b081-4df5-9638-920fb51000c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1527021879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3512c35-17d4-47e6-99b3-df583371f822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:35Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d60c7b5-4f10-4f65-ba83-da509f78c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d60c7b5-4f10-4f65-ba83-da509f78c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf22af2b-2240-492a-85d0-b25abf709544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf22af2b-2240-492a-85d0-b25abf709544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3512c35-17d4-47e6-99b3-df583371f822', 'volume_name': 'volume-f3512c35-17d4-47e6-99b3-df583371f822', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e701cd-9d25-4a39-b4d7-3fb1e0815809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e701cd-9d25-4a39-b4d7-3fb1e0815809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d6ac5-8552-4cbb-a3a5-515f3b20a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:34 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Volume f3512c35-17d4-47e6-99b3-df583371f822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3512c35-17d4-47e6-99b3-df583371f822', 'volume_size': 1}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-08f1a8f5-b554-4eeb-ac7d-6c9016521bee" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Deleting offline snapshot 08f1a8f5-b554-4eeb-ac7d-6c9016521bee of volume 18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] snapshot_file for this snap is: volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d1831-d72d-4b61-b124-32594bdda8db]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:34 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 1073741824" returned: 0 in 0.958s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:34 devstack sudo[110361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5
Jun 29 05:00:34 devstack sudo[110361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:34 devstack sudo[110360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee
Jun 29 05:00:34 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:35 devstack sudo[110361]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5" returned: 0 in 0.663s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144293799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee6f925-dfcd-4d3d-a880-d75bbdb229f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:33Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Creating volume fee6f925-dfcd-4d3d-a880-d75bbdb229f4 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:35 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecca9f48-b2a5-4963-938b-c4bd8ceba295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df554096-8c7d-4c87-b412-b220ac9e10c5', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:35 devstack sudo[110369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 1073741824
Jun 29 05:00:35 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539e062e-5374-42a7-bafe-f768ee857f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:35 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee" returned: 0 in 0.796s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:00:35 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Volume volume-df554096-8c7d-4c87-b412-b220ac9e10c5 (df554096-8c7d-4c87-b412-b220ac9e10c5): created successfully
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539e062e-5374-42a7-bafe-f768ee857f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (a6eef0fa-a09c-45c9-8fd8-0f6426ffeb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece12f41-7220-4823-9b09-a9c70012d8fd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:35 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6c2a600f-5d68-438a-bb0f-19e3d7876f24 tempest-CreateVolumesFromImageTest-94967679 None] Created volume successfully.
Jun 29 05:00:35 devstack sudo[110371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4
Jun 29 05:00:35 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:36 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 1073741824" returned: 0 in 0.802s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:36 devstack sudo[110379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4
Jun 29 05:00:36 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:36 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4" returned: 0 in 0.804s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:36 devstack sudo[110381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee
Jun 29 05:00:36 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:37 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" returned: 0 in 0.659s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.045s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1896372549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:34Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Creating volume 82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:37 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9854c0c1-68af-4c96-a3f9-ce67906baf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:37 devstack sudo[110387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 1073741824
Jun 29 05:00:37 devstack sudo[110387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420981c6-8d83-4f3f-a34e-7a7a6203598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Volume volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 (fee6f925-dfcd-4d3d-a880-d75bbdb229f4): created successfully
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420981c6-8d83-4f3f-a34e-7a7a6203598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (a1c7e624-67e4-4283-8f10-7700698d0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f3f974a2-78a3-4925-b387-b2fdbc176841 tempest-CreateVolumesFromImageTest-94967679 None] Created volume successfully.
Jun 29 05:00:37 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee" returned: 0 in 0.844s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:37 devstack sudo[110389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee
Jun 29 05:00:37 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:37 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4.08f1a8f5-b554-4eeb-ac7d-6c9016521bee" returned: 0 in 0.681s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:37 devstack sudo[110387]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 1073741824" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-08f1a8f5-b554-4eeb-ac7d-6c9016521bee" released by "_delete_snapshot" :: held 3.246s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" released by "delete_snapshot" :: held 3.309s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:38 devstack sudo[110398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4
Jun 29 05:00:38 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Created reservations ['c2b7f6ab-e5fa-439d-b00f-46fb48a996b8', '426b2005-33cd-4e6f-a9cd-5b526496055d', '79554a3f-388a-4240-af79-485964ced5a9', 'f2bb0a3c-4974-4963-8ce7-2bd7599ef6c1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Delete snapshot completed successfully.
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-d3d5d290-b0b8-4595-975e-a1bede4c6cac tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-08f1a8f5-b554-4eeb-ac7d-6c9016521bee-delete_snapshot" released by "delete_snapshot" :: held 3.522s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:38 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" returned: 0 in 0.693s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.409s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1365711338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e458f-7fc6-438d-be5e-60806d839a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:34Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Creating volume 3a1e458f-7fc6-438d-be5e-60806d839a60 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:38 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8148ec0-c170-465f-ab39-743f07db2768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:38 devstack sudo[110401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 1073741824
Jun 29 05:00:38 devstack sudo[110401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c584c3d-f061-4cfd-a034-089afc7a0fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Volume volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 (82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4): created successfully
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c584c3d-f061-4cfd-a034-089afc7a0fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (6b4fe536-92e7-4980-97e4-c5713ccd0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-384d5403-22aa-4b4e-a96b-f267fd0ecc64 tempest-CreateVolumesFromImageTest-94967679 None] Created volume successfully.
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "cinder-18e07fca-e95a-40d7-9d03-bd3544fac9b4-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-18e07fca-e95a-40d7-9d03-bd3544fac9b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b3f1d-1874-4001-bf0a-3f3839e79f14]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:39 devstack sudo[110403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4
Jun 29 05:00:39 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:39 devstack sudo[110401]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 1073741824" returned: 0 in 0.892s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:39 devstack sudo[110408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60
Jun 29 05:00:39 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:39 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4" returned: 0 in 0.812s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:39 devstack sudo[110413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4
Jun 29 05:00:39 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:40 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60" returned: 0 in 0.659s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.596s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1527021879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3512c35-17d4-47e6-99b3-df583371f822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eddccfceb674b0e8d61537136cbb2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:35Z,use_quota=True,user_id='19cbc87dd36a40b1877a0c2b9df6b2ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Creating volume f3512c35-17d4-47e6-99b3-df583371f822 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:40 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b815a99-2211-4b99-81c0-6a7967111846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1e458f-7fc6-438d-be5e-60806d839a60', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8319cb2-c7f2-415f-ac75-779f0686b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:40 devstack sudo[110416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 1073741824
Jun 29 05:00:40 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Volume volume-3a1e458f-7fc6-438d-be5e-60806d839a60 (3a1e458f-7fc6-438d-be5e-60806d839a60): created successfully
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8319cb2-c7f2-415f-ac75-779f0686b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (f57a28ca-dcea-4676-a8ee-894a67b894af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-589ab04a-3433-49eb-858c-92a751910a12 tempest-CreateVolumesFromImageTest-94967679 None] Created volume successfully.
Jun 29 05:00:40 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-18e07fca-e95a-40d7-9d03-bd3544fac9b4" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-quobyte-18e07fca-e95a-40d7-9d03-bd3544fac9b4" released by "delete_volume" :: held 1.523s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Created reservations ['22154ea1-9958-48ba-989e-d0cb614fbdd4', 'd7b0d52a-ba01-436c-93d1-bcb8ec6b224b', 'c21ffbe3-2bd0-4283-9658-ed6dc2c571ed', '3c9181cb-2c08-461b-9f00-90195b0394d5'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:40 devstack sudo[110419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:40 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:41 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 1073741824" returned: 0 in 0.927s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:41 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.671s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:41 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Deleted volume successfully.
Jun 29 05:00:41 devstack sudo[110426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822
Jun 29 05:00:41 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b670f781-be63-4e8e-8911-96fe8913f7b7 tempest-VolumesSnapshotNegativeTestJSON-444451185 None] Lock "cinder-18e07fca-e95a-40d7-9d03-bd3544fac9b4-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:42 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d6ac5-8552-4cbb-a3a5-515f3b20a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3512c35-17d4-47e6-99b3-df583371f822', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf67ab-9064-4ec1-af99-ab51ea1f15d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:42 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Volume volume-f3512c35-17d4-47e6-99b3-df583371f822 (f3512c35-17d4-47e6-99b3-df583371f822): created successfully
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf67ab-9064-4ec1-af99-ab51ea1f15d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Flow 'volume_create_manager' (92ca172f-a472-49ed-9718-cb33a8d2cab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:42 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dd5b46f9-285b-4537-9c14-83dc2843df42 tempest-CreateVolumesFromImageTest-94967679 None] Created volume successfully.
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-f3512c35-17d4-47e6-99b3-df583371f822-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-f3512c35-17d4-47e6-99b3-df583371f822-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-quobyte-f3512c35-17d4-47e6-99b3-df583371f822" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-f3512c35-17d4-47e6-99b3-df583371f822" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e048a2-f7b2-4d51-9d5f-516ec570dc2e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:42 devstack sudo[110430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822
Jun 29 05:00:42 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:43 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822" returned: 0 in 0.783s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:43 devstack sudo[110435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822
Jun 29 05:00:43 devstack sudo[110435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:43 devstack sudo[110435]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f3512c35-17d4-47e6-99b3-df583371f822" returned: 0 in 0.661s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-f3512c35-17d4-47e6-99b3-df583371f822" released by "delete_volume" :: held 1.495s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Created reservations ['2e429742-88e7-4d41-9e89-599d42aaaeae', 'c3a6680b-7922-42fc-b849-b23f0b95e1f4', '3015bda7-26e8-48aa-95a6-423ba7804b1a', 'd869628c-0f31-4f14-8cc6-1db38268bfc6'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:44 devstack sudo[110440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:44 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-3a1e458f-7fc6-438d-be5e-60806d839a60-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-3a1e458f-7fc6-438d-be5e-60806d839a60-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:44 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.680s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-quobyte-3a1e458f-7fc6-438d-be5e-60806d839a60" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:44 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Deleted volume successfully.
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-3a1e458f-7fc6-438d-be5e-60806d839a60" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-90b2dbd3-ad64-4d2a-b548-8be61ee989eb tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-f3512c35-17d4-47e6-99b3-df583371f822-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2784488-2440-476b-8625-bc1558f28f0a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:44 devstack sudo[110443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60
Jun 29 05:00:44 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:45 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60" returned: 0 in 0.815s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:45 devstack sudo[110449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60
Jun 29 05:00:45 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:46 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-3a1e458f-7fc6-438d-be5e-60806d839a60" returned: 0 in 0.694s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-3a1e458f-7fc6-438d-be5e-60806d839a60" released by "delete_volume" :: held 1.556s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Created reservations ['b6282131-2c9e-4dcb-bf1a-a9a75cacc8f4', '25d2a7a1-77ed-4bd8-aca2-1c2ac5667bdc', '09a7c070-fc93-452d-b0ed-8a1bf5b57a75', 'e80569e5-9c07-43cc-9e35-813155534320'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:46 devstack sudo[110452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:46 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-quobyte-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:46 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067cc4b-10ca-4d62-90a2-fb86babf180e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:47 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Deleted volume successfully.
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e8781acc-c5f6-47d1-8edc-e0e23006141e tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-3a1e458f-7fc6-438d-be5e-60806d839a60-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:47 devstack sudo[110455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4
Jun 29 05:00:47 devstack sudo[110455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:47 devstack sudo[110455]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" returned: 0 in 0.780s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:47 devstack sudo[110466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4
Jun 29 05:00:47 devstack sudo[110466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:48 devstack sudo[110466]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" returned: 0 in 0.787s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4" released by "delete_volume" :: held 1.615s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Created reservations ['6e8cb329-4bc2-489e-9261-31d1420ba6ef', '7e809261-df31-4d4e-895c-832d07ec9afd', 'cb23b412-1725-4843-85c9-e95e926552aa', 'f1b6d8e8-2c59-4b59-a107-f5edbd23b777'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:48 devstack sudo[110469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:48 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-fee6f925-dfcd-4d3d-a880-d75bbdb229f4-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-fee6f925-dfcd-4d3d-a880-d75bbdb229f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-quobyte-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dce633-31a9-4a43-b10f-bb37ac7a2a40]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:49 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:49 devstack sudo[110471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4
Jun 29 05:00:49 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.692s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:49 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Deleted volume successfully.
Jun 29 05:00:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5723fff7-6548-418a-b28a-78aba997cde9 tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-82ddcf29-f7e9-4b2d-8d3c-81827f69cdf4-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:50 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" returned: 0 in 0.843s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:50 devstack sudo[110479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4
Jun 29 05:00:50 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:50 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" returned: 0 in 0.701s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-fee6f925-dfcd-4d3d-a880-d75bbdb229f4" released by "delete_volume" :: held 1.592s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Created reservations ['c7251fb2-7640-404a-b6b7-5689e5c10639', 'bace2c54-0bb2-44da-a522-c307e72d0d2c', '1a88b3ba-4bf0-48e9-a46c-a0953cce3f4c', '2f633dc8-6a25-4685-b481-5c676d87efc5'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:51 devstack sudo[110482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:51 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-df554096-8c7d-4c87-b412-b220ac9e10c5-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-df554096-8c7d-4c87-b412-b220ac9e10c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "cinder-quobyte-df554096-8c7d-4c87-b412-b220ac9e10c5" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-df554096-8c7d-4c87-b412-b220ac9e10c5" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91df48e-72cb-4971-b4d3-400fecf39d21]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:51 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:51 devstack sudo[110487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5
Jun 29 05:00:51 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.705s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Deleted volume successfully.
Jun 29 05:00:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a9c3a957-09be-4967-8cdd-c60cc026076c tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-fee6f925-dfcd-4d3d-a880-d75bbdb229f4-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:52 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5" returned: 0 in 0.787s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:52 devstack sudo[110492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5
Jun 29 05:00:52 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:53 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-df554096-8c7d-4c87-b412-b220ac9e10c5" returned: 0 in 0.678s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-quobyte-df554096-8c7d-4c87-b412-b220ac9e10c5" released by "delete_volume" :: held 1.512s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Created reservations ['ce2a34b9-b466-42f7-ab04-7802d22f0a94', '5d3c27de-71bd-4956-bcd7-6718e83ea40d', '0969698e-8c3e-40c3-a9f4-3c249ae9160d', '34f647a5-d84f-406b-a811-8f4aed9c10a7'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:53 devstack sudo[110495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:00:53 devstack sudo[110495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:53 devstack sudo[110495]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.767s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:00:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Deleted volume successfully.
Jun 29 05:00:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-96616753-a1b3-4e64-951c-b1e36333a5bc tempest-CreateVolumesFromImageTest-94967679 None] Lock "cinder-df554096-8c7d-4c87-b412-b220ac9e10c5-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Flow 'volume_create_manager' (b690e533-1d89-453d-b004-8cc0f645d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2c0635-4ffb-409c-ab92-23d9ff6c2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2c0635-4ffb-409c-ab92-23d9ff6c2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1692258727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd33e242-6d4d-4f99-9444-04e2ea09e655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4542670ce9b45409b556a5bfc1fa2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:57Z,use_quota=True,user_id='2efe79748b304e088d512df8a5b80438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09aed81-a314-49b3-b86b-1fd8202aaf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09aed81-a314-49b3-b86b-1fd8202aaf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd69fb2-a4a9-44f2-9d4c-26155f8318bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd69fb2-a4a9-44f2-9d4c-26155f8318bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd33e242-6d4d-4f99-9444-04e2ea09e655', 'volume_name': 'volume-cd33e242-6d4d-4f99-9444-04e2ea09e655', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d6513c-a44e-4eb7-8d64-f7633c0447df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d6513c-a44e-4eb7-8d64-f7633c0447df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222a520f-9b2e-445a-b70f-97e77dc917ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Volume cd33e242-6d4d-4f99-9444-04e2ea09e655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd33e242-6d4d-4f99-9444-04e2ea09e655', 'volume_size': 1}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1692258727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd33e242-6d4d-4f99-9444-04e2ea09e655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4542670ce9b45409b556a5bfc1fa2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:00:57Z,use_quota=True,user_id='2efe79748b304e088d512df8a5b80438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Creating volume cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:00:56 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:00:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:56 devstack sudo[110499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 1073741824
Jun 29 05:00:56 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:57 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 1073741824" returned: 0 in 0.873s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:57 devstack sudo[110505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:00:57 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:00:58 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.654s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222a520f-9b2e-445a-b70f-97e77dc917ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd33e242-6d4d-4f99-9444-04e2ea09e655', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfc0044-9109-4597-8dd1-8509689ccfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:00:58 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Volume volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 (cd33e242-6d4d-4f99-9444-04e2ea09e655): created successfully
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfc0044-9109-4597-8dd1-8509689ccfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:00:58 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Flow 'volume_create_manager' (b690e533-1d89-453d-b004-8cc0f645d080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:00:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dd94bb0c-126b-4bbe-b403-a9e98a80a6ad tempest-VolumeDependencyTests-804741698 None] Created volume successfully.
Jun 29 05:00:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:00:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:00:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Creating offline snapshot 090aa460-cd99-4f38-9d96-59536d386125 of volume cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:00:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c572f-bb53-4d40-9c18-8f647a954812]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:00:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:00:59 devstack sudo[110508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:00:59 devstack sudo[110508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:00 devstack sudo[110508]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.814s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:00 devstack sudo[110514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 1G
Jun 29 05:01:00 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:01 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 1G" returned: 0 in 0.920s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:01 devstack sudo[110521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:01 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:01 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.744s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:01 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 is being set with open permissions: ugo+rw
Jun 29 05:01:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:01 devstack sudo[110527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:01 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:02 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.761s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:02 devstack sudo[110530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info
Jun 29 05:01:02 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:03 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info" returned: 0 in 0.703s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:03 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info is being set with open permissions: ugo+rw
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:03 devstack sudo[110533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info
Jun 29 05:01:03 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:03 devstack sudo[110535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:01:03 devstack sudo[110535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Flow 'volume_create_manager' (526536b9-c80f-464f-9c66-90faee8f6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48d7746-0106-416e-b8b9-ff8c37e7b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48d7746-0106-416e-b8b9-ff8c37e7b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114916339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04fd007-1306-472e-bbcf-037dbc5a5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600c31b93904ef388ff7028db070991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:01:04Z,use_quota=True,user_id='b5408402e3f64ca4a9473c715fb3ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7fe8e-814b-4192-be7b-bf1a2e73c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7fe8e-814b-4192-be7b-bf1a2e73c026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2404219d-0951-40ac-9f17-2a8d548fb479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2404219d-0951-40ac-9f17-2a8d548fb479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04fd007-1306-472e-bbcf-037dbc5a5b9d', 'volume_name': 'volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec40dc5-7452-43b0-b0e9-ec8bd6bdfab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec40dc5-7452-43b0-b0e9-ec8bd6bdfab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1004e80-ff7a-4073-8220-23f41bfa5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:03 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume d04fd007-1306-472e-bbcf-037dbc5a5b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d', 'volume_size': 1}
Jun 29 05:01:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Flow 'volume_create_manager' (9e64f236-0596-4cab-8808-e48a2b405bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57ab0fa-cc47-4112-8b31-5650cd65f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:04 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57ab0fa-cc47-4112-8b31-5650cd65f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-192377651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f15037-e9fa-4424-aca6-a81669aa0c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600c31b93904ef388ff7028db070991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:01:04Z,use_quota=True,user_id='b5408402e3f64ca4a9473c715fb3ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e29e768-ea62-47e6-8bfd-e1c2e1403a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e29e768-ea62-47e6-8bfd-e1c2e1403a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a3e953-56bf-4964-9ba7-3a9b25ce0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a3e953-56bf-4964-9ba7-3a9b25ce0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f15037-e9fa-4424-aca6-a81669aa0c47', 'volume_name': 'volume-45f15037-e9fa-4424-aca6-a81669aa0c47', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedca7fc-ba63-43b0-8206-651964e48872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedca7fc-ba63-43b0-8206-651964e48872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa141e56-ec37-454a-b781-5a622f3e9ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume 45f15037-e9fa-4424-aca6-a81669aa0c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f15037-e9fa-4424-aca6-a81669aa0c47', 'volume_size': 1}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.info" returned: 0 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.849s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114916339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04fd007-1306-472e-bbcf-037dbc5a5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600c31b93904ef388ff7028db070991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:01:04Z,use_quota=True,user_id='b5408402e3f64ca4a9473c715fb3ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Creating volume d04fd007-1306-472e-bbcf-037dbc5a5b9d {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:01:04 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:04 devstack sudo[110539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d 1073741824
Jun 29 05:01:04 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:04 devstack sudo[110535]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bdae9f33-8a71-44e1-90ac-3f26e0efa4cd tempest-VolumeDependencyTests-804741698 None] Create snapshot completed successfully
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.892s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:01:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Flow 'volume_create_manager' (123831e2-7e5f-454b-8108-2595022804c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a03d95f-9481-4a72-bd8b-410bddb297ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a03d95f-9481-4a72-bd8b-410bddb297ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1451807790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e3776-9d49-450c-8dd9-6e01eaf610cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4542670ce9b45409b556a5bfc1fa2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=090aa460-cd99-4f38-9d96-59536d386125,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:01:05Z,use_quota=True,user_id='2efe79748b304e088d512df8a5b80438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0d14fa-dae0-4fdc-bb23-040916c0085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0d14fa-dae0-4fdc-bb23-040916c0085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c04068-4a29-4e60-9ebe-bb84c4f06c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c04068-4a29-4e60-9ebe-bb84c4f06c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b98e3776-9d49-450c-8dd9-6e01eaf610cf', 'volume_name': 'volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf', 'volume_size': 1, 'snapshot_id': '090aa460-cd99-4f38-9d96-59536d386125'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc800462-3003-4d59-a81e-98387424ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc800462-3003-4d59-a81e-98387424ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89154b3a-05be-4ea0-b0e4-471efaa65629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:05 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Volume b98e3776-9d49-450c-8dd9-6e01eaf610cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf', 'volume_size': 1, 'snapshot_id': '090aa460-cd99-4f38-9d96-59536d386125'}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:05 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d 1073741824" returned: 0 in 1.137s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:05 devstack sudo[110545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d
Jun 29 05:01:05 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:06 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d" returned: 0 in 0.661s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.877s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-192377651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f15037-e9fa-4424-aca6-a81669aa0c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600c31b93904ef388ff7028db070991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:01:04Z,use_quota=True,user_id='b5408402e3f64ca4a9473c715fb3ede7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Creating volume 45f15037-e9fa-4424-aca6-a81669aa0c47 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:01:06 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:06 devstack sudo[110549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 1073741824
Jun 29 05:01:06 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1004e80-ff7a-4073-8220-23f41bfa5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa404b3-e80b-4ff7-a255-c1c74d6fb099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:06 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d (d04fd007-1306-472e-bbcf-037dbc5a5b9d): created successfully
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa404b3-e80b-4ff7-a255-c1c74d6fb099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Flow 'volume_create_manager' (526536b9-c80f-464f-9c66-90faee8f6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:06 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-d8353faf-68fe-401f-bc14-8c31c8e28d04 tempest-TestServerVolumeAttachmentScenario-786774009 None] Created volume successfully.
Jun 29 05:01:06 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 1073741824" returned: 0 in 0.900s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:06 devstack sudo[110555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47
Jun 29 05:01:06 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:07 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.361s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125-b98e3776-9d49-450c-8dd9-6e01eaf610cf" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa141e56-ec37-454a-b781-5a622f3e9ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f15037-e9fa-4424-aca6-a81669aa0c47', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0486c-9c71-4afe-be61-28edeae53637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125-b98e3776-9d49-450c-8dd9-6e01eaf610cf" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Creating volume b98e3776-9d49-450c-8dd9-6e01eaf610cf from snapshot 090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Volume volume-45f15037-e9fa-4424-aca6-a81669aa0c47 (45f15037-e9fa-4424-aca6-a81669aa0c47): created successfully
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0486c-9c71-4afe-be61-28edeae53637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Flow 'volume_create_manager' (9e64f236-0596-4cab-8808-e48a2b405bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] snapshot: 090aa460-cd99-4f38-9d96-59536d386125, volume: b98e3776-9d49-450c-8dd9-6e01eaf610cf,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-712fef5c-0015-4d2a-a70b-f600756656e1 tempest-TestServerVolumeAttachmentScenario-786774009 None] Created volume successfully.
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb45b6-f73f-40cc-af14-ea5e37e7349e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:07 devstack sudo[110561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:07 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:08 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.749s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd33e242-6d4d-4f99-9444-04e2ea09e655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c9793-299a-4e93-be1c-070fb95d8598]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:08 devstack sudo[110566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:01:08 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:09 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.787s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:09 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 05:01:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:09 devstack sudo[110571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf
Jun 29 05:01:09 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:14 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf" returned: 0 in 5.625s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:15 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[36185733-e7f3-429a-8daf-42cace290c4a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:15 devstack sudo[110636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:01:15 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:15 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.989s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:15 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:01:15 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Converted 1024.00 MB image at 182.01 MB/s
Jun 29 05:01:15 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf is being set with open permissions: ugo+rw
Jun 29 05:01:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:16 devstack sudo[110643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf
Jun 29 05:01:16 devstack sudo[110643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:16 devstack sudo[110643]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf" returned: 0 in 0.658s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" released by "_copy_volume_from_snapshot" :: held 8.927s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125-b98e3776-9d49-450c-8dd9-6e01eaf610cf" released by "_create_volume_from_snapshot" :: held 8.967s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=97,cinder:INSERT=37,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=97,cinder:INSERT=34,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89154b3a-05be-4ea0-b0e4-471efaa65629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf', 'volume_size': 1, 'snapshot_id': '090aa460-cd99-4f38-9d96-59536d386125'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb399f76-cf56-4fa3-a00c-e13b745ea3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:01:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Volume volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf (b98e3776-9d49-450c-8dd9-6e01eaf610cf): created successfully
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb399f76-cf56-4fa3-a00c-e13b745ea3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:01:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Flow 'volume_create_manager' (123831e2-7e5f-454b-8108-2595022804c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:01:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1c5e17a8-426c-4a46-95e7-068d0bf29fc2 tempest-VolumeDependencyTests-804741698 None] Created volume successfully.
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-090aa460-cd99-4f38-9d96-59536d386125-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-090aa460-cd99-4f38-9d96-59536d386125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Deleting offline snapshot 090aa460-cd99-4f38-9d96-59536d386125 of volume cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] snapshot_file for this snap is: volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[559dcef1-362b-4b5c-848e-8bb11926213c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:17 devstack sudo[110646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:17 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:18 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.771s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd33e242-6d4d-4f99-9444-04e2ea09e655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39565a-efbc-4214-a0cb-398e94cf6a5e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:18 devstack sudo[110651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:01:18 devstack sudo[110651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:18 devstack sudo[110651]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.778s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:18 devstack sudo[110659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:18 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:19 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.698s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:19 devstack sudo[110664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125
Jun 29 05:01:19 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:20 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655.090aa460-cd99-4f38-9d96-59536d386125" returned: 0 in 0.633s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-090aa460-cd99-4f38-9d96-59536d386125" released by "_delete_snapshot" :: held 2.972s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" released by "delete_snapshot" :: held 2.993s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Created reservations ['c7f6a1c4-51fb-4179-8219-3009cd4c056c', 'cc62313c-92ef-41c3-b28b-813beb754399', '52b591e3-bc91-44be-b708-8eadeb1235c0', '03aedf16-4483-4d14-9170-56c9f0f0f7b3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:01:20 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Delete snapshot completed successfully.
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-59b9df92-f03d-45ae-89ee-5198c5639880 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-090aa460-cd99-4f38-9d96-59536d386125-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-cd33e242-6d4d-4f99-9444-04e2ea09e655-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "cinder-cd33e242-6d4d-4f99-9444-04e2ea09e655-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e37230-934e-41c2-9a3b-f31f1eeb607f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:20 devstack sudo[110673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:01:20 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:21 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 1.034s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:21 devstack sudo[110745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655
Jun 29 05:01:21 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:22 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cd33e242-6d4d-4f99-9444-04e2ea09e655" returned: 0 in 0.830s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-cd33e242-6d4d-4f99-9444-04e2ea09e655" released by "delete_volume" :: held 1.925s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Created reservations ['3c105cdd-6372-47f1-82e2-ff2cb99876e7', '774f7fbb-43dc-47c5-93a9-456595dc0740', 'c8069ac3-b61b-4236-816b-30402428d13e', '961c0bd4-8d75-41c7-ae0e-3532aa305806'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:22 devstack sudo[110759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:01:22 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-b98e3776-9d49-450c-8dd9-6e01eaf610cf-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-b98e3776-9d49-450c-8dd9-6e01eaf610cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" acquired by "delete_volume" :: waited 0.030s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92c6c0-d431-4be2-a8e6-9fd0cd8e13eb]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:23 devstack sudo[110761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf
Jun 29 05:01:23 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:23 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.800s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:01:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Deleted volume successfully.
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-984ec388-c469-4845-838a-097d700da39c tempest-VolumeDependencyTests-804741698 None] Lock "cinder-cd33e242-6d4d-4f99-9444-04e2ea09e655-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:23 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf" returned: 0 in 0.887s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:23 devstack sudo[110768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf
Jun 29 05:01:23 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:24 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b98e3776-9d49-450c-8dd9-6e01eaf610cf" returned: 0 in 0.749s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-quobyte-b98e3776-9d49-450c-8dd9-6e01eaf610cf" released by "delete_volume" :: held 1.712s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Created reservations ['d77440fa-1ce9-4b3e-bf3f-84daeb3a81f1', '8ed8cfd6-31de-4081-be77-06c84846cd53', 'e3c3378f-712d-4fb7-af71-514e8c4a1eaf', 'd8066eed-f7e9-4fda-8e71-84f9e7121a40'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:24 devstack sudo[110771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:01:24 devstack sudo[110771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:25 devstack sudo[110771]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.784s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:25 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:01:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Deleted volume successfully.
Jun 29 05:01:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-82f30210-2add-40eb-869a-1bdf6ae89d47 tempest-VolumeDependencyTests-804741698 None] Lock "cinder-b98e3776-9d49-450c-8dd9-6e01eaf610cf-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:01:34 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:01:35 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=20,cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=5 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:01:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca828b-1294-4b39-b590-81917b257886]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:49 devstack sudo[110825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d
Jun 29 05:01:49 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:01:50 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root
Jun 29 05:01:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d" returned: 0 in 0.809s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:01:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:01:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36d487a5-9381-4609-b27d-5f39c93dd96d', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 05:01:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-3d624211-79a5-4f01-b9c3-3f02442e5cd0 req-52266d41-0b46-4287-a3cc-8b446beef84b tempest-TestServerVolumeAttachmentScenario-786774009 None] attachment_update completed successfully.
Jun 29 05:01:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:01:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:01:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e6e15-ffef-4ddc-865e-a43d771a4890]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:01:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:01:59 devstack sudo[111227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47
Jun 29 05:01:59 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:00 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47" returned: 0 in 0.736s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.752s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-45f15037-e9fa-4424-aca6-a81669aa0c47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee88cf91-cb22-4d6f-9524-8dec972e4daf', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 05:02:00 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-feb7bbfe-f20c-41f5-b6a1-6791e5845038 req-238880f9-ba38-4be1-b32a-268d22ab8fcb tempest-TestServerVolumeAttachmentScenario-786774009 None] attachment_update completed successfully.
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:03 devstack sudo[111237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:02:03 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:04 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.649s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:02:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:02:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:02:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:02:06 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-d17f2290-3071-4997-b769-11cf1a03d26e req-02bb66f9-b247-4f39-8e42-d548bf642426 tempest-TestServerVolumeAttachmentScenario-786774009 None] Terminate volume connection completed successfully.
Jun 29 05:02:06 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-d17f2290-3071-4997-b769-11cf1a03d26e req-02bb66f9-b247-4f39-8e42-d548bf642426 tempest-TestServerVolumeAttachmentScenario-786774009 None] Deleting attachment ee88cf91-cb22-4d6f-9524-8dec972e4daf. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 05:02:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-1f7914ef-283b-4543-b31c-3184997f0645 req-2556c4c6-729a-4dc8-8a40-15ae5e371450 tempest-TestServerVolumeAttachmentScenario-786774009 None] Terminate volume connection completed successfully.
Jun 29 05:02:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-1f7914ef-283b-4543-b31c-3184997f0645 req-2556c4c6-729a-4dc8-8a40-15ae5e371450 tempest-TestServerVolumeAttachmentScenario-786774009 None] Deleting attachment 36d487a5-9381-4609-b27d-5f39c93dd96d. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 05:02:16 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=17,cinder:UPDATE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "cinder-45f15037-e9fa-4424-aca6-a81669aa0c47-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-45f15037-e9fa-4424-aca6-a81669aa0c47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "cinder-quobyte-45f15037-e9fa-4424-aca6-a81669aa0c47" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-quobyte-45f15037-e9fa-4424-aca6-a81669aa0c47" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d1795-eef1-4ae2-b88a-9665bc3bcc1a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:19 devstack sudo[111361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47
Jun 29 05:02:19 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:20 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47" returned: 0 in 0.769s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:20 devstack sudo[111366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47
Jun 29 05:02:20 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:21 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-45f15037-e9fa-4424-aca6-a81669aa0c47" returned: 0 in 0.610s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-quobyte-45f15037-e9fa-4424-aca6-a81669aa0c47" released by "delete_volume" :: held 1.418s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Created reservations ['cb0e6d2c-16ef-4b48-94ef-c049ab9de0b6', 'fbf9d156-ba91-41d5-a103-fbb1d4e8a713', 'fc8ac8b0-9df9-4f48-b767-edc013004967', '6752c600-e5cd-4cfd-b820-a78b7b7398e0'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:21 devstack sudo[111369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:02:21 devstack sudo[111369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "cinder-d04fd007-1306-472e-bbcf-037dbc5a5b9d-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:02:21 devstack sudo[111369]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-d04fd007-1306-472e-bbcf-037dbc5a5b9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.657s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:21 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:02:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Deleted volume successfully.
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-c937441d-ebc2-425e-acd9-03de69a2d424 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-45f15037-e9fa-4424-aca6-a81669aa0c47-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "cinder-quobyte-d04fd007-1306-472e-bbcf-037dbc5a5b9d" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-quobyte-d04fd007-1306-472e-bbcf-037dbc5a5b9d" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbadab61-ea90-4c4b-a9f9-20869218cdf8]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:22 devstack sudo[111372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d
Jun 29 05:02:22 devstack sudo[111372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:22 devstack sudo[111372]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d" returned: 0 in 0.734s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:22 devstack sudo[111377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d
Jun 29 05:02:22 devstack sudo[111377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:23 devstack sudo[111377]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-d04fd007-1306-472e-bbcf-037dbc5a5b9d" returned: 0 in 0.657s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-quobyte-d04fd007-1306-472e-bbcf-037dbc5a5b9d" released by "delete_volume" :: held 1.430s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Created reservations ['8b3378e8-7eed-4fe2-8ac0-3357a5d30fcb', '5aed2998-fad7-4ce9-bb36-ba3d3bbeab06', 'fae3228b-3df1-4f63-bac5-7b494c9a49e0', 'ff652b79-5041-4200-a8eb-0f29a6e1d64f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:23 devstack sudo[111380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:02:23 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:24 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.645s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:24 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:02:24 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Deleted volume successfully.
Jun 29 05:02:24 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0cd8544c-4f8c-4253-9934-371a20047357 tempest-TestServerVolumeAttachmentScenario-786774009 None] Lock "cinder-d04fd007-1306-472e-bbcf-037dbc5a5b9d-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:02:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:02:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=17 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Flow 'volume_create_manager' (4a681c29-577c-4848-a3ad-d726cdc7a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fed140-28d1-43e2-a6e5-886ad8adfa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fed140-28d1-43e2-a6e5-886ad8adfa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-315011392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b71cc-59ab-4815-bfe6-463027dd1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8607648a6344b991ed466d865c98f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:02:54Z,use_quota=True,user_id='6df0da16ee394feb95ac9fde02a408b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0926cd-4d8a-4907-ad92-68ce87736dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0926cd-4d8a-4907-ad92-68ce87736dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f8a01e-879e-450e-971d-83953ff9dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f8a01e-879e-450e-971d-83953ff9dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac1b71cc-59ab-4815-bfe6-463027dd1626', 'volume_name': 'volume-ac1b71cc-59ab-4815-bfe6-463027dd1626', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872f33830>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20289f7-d2c9-4688-b22f-73378a6502af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20289f7-d2c9-4688-b22f-73378a6502af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d305b5-12cf-4339-bdcf-5a6fc95d525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:02:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Volume ac1b71cc-59ab-4815-bfe6-463027dd1626: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac1b71cc-59ab-4815-bfe6-463027dd1626', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872f33830>}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Trying to clone ac1b71cc-59ab-4815-bfe6-463027dd1626 from image 715ee343-4947-44c8-82ac-b52ccc04493d at location (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 05:02:54 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Image download 20.69 MB at 20.69 MB/s
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae8bea-835e-4cb3-81cc-b711d3e30580]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:54 devstack sudo[111404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD
Jun 29 05:02:54 devstack sudo[111404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:55 devstack sudo[111404]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:55 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d is fetched for user 6df0da16ee394feb95ac9fde02a408b5. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 05:02:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a6766-f39d-4e39-a67d-23dc7ba8a0f3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:55 devstack sudo[111410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD
Jun 29 05:02:55 devstack sudo[111410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:56 devstack sudo[111410]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-315011392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b71cc-59ab-4815-bfe6-463027dd1626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8607648a6344b991ed466d865c98f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:02:54Z,use_quota=True,user_id='6df0da16ee394feb95ac9fde02a408b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Creating volume ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:02:56 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:02:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:56 devstack sudo[111416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1073741824
Jun 29 05:02:56 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:57 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1073741824" returned: 0 in 0.784s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:57 devstack sudo[111422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:02:57 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:57 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.628s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Attempting download of 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume ac1b71cc-59ab-4815-bfe6-463027dd1626. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cae352-2db3-4740-9763-d391ed981ab7]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_ {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:58 devstack sudo[111425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_
Jun 29 05:02:58 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:58 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_" returned: 0 in 0.716s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_ {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:58 devstack sudo[111429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_
Jun 29 05:02:58 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:02:59 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root
Jun 29 05:02:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_" returned: 1 in 0.711s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:02:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_715ee343-4947-44c8-82ac-b52ccc04493d_kcp2v2h_' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:02:59 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d79baf1-67da-4760-a617-dbc99e33f0ab]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:02:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:02:59 devstack sudo[111433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD
Jun 29 05:02:59 devstack sudo[111433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:00 devstack sudo[111433]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:00 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] 715ee343-4947-44c8-82ac-b52ccc04493d was qcow2, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 05:03:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:00 devstack sudo[111438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:00 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:01 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 1.752s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:01 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_715ee343-4947-44c8-82ac-b52ccc04493d__kle9dzzdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:03:01 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Converted 112.00 MB image at 63.89 MB/s
Jun 29 05:03:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:01 devstack sudo[111447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1G
Jun 29 05:03:01 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:02 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 1G" returned: 0 in 0.692s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:02 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbcea4-d7c2-4d2d-8917-b0a835a01792]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:03:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:02 devstack sudo[111452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:02 devstack sudo[111452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:03 devstack sudo[111452]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:03 devstack sudo[111456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:03 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:03:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:03 devstack sudo[111458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:03:03 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:04 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 1 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Downloaded image 715ee343-4947-44c8-82ac-b52ccc04493d ((None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}])) to volume ac1b71cc-59ab-4815-bfe6-463027dd1626 successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Temporary image 715ee343-4947-44c8-82ac-b52ccc04493d for user 6df0da16ee394feb95ac9fde02a408b5 is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Marking volume ac1b71cc-59ab-4815-bfe6-463027dd1626 as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Copying metadata from image 715ee343-4947-44c8-82ac-b52ccc04493d to ac1b71cc-59ab-4815-bfe6-463027dd1626. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Creating volume glance metadata for volume ac1b71cc-59ab-4815-bfe6-463027dd1626 backed by image 715ee343-4947-44c8-82ac-b52ccc04493d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d305b5-12cf-4339-bdcf-5a6fc95d525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1b71cc-59ab-4815-bfe6-463027dd1626', 'volume_size': 1, 'image_id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/715ee343-4947-44c8-82ac-b52ccc04493d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1eb96738d4684c2d97d817689c82f469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '715ee343-4947-44c8-82ac-b52ccc04493d', 'created_at': datetime.datetime(2026, 6, 29, 2, 37, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 2, 37, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/715ee343-4947-44c8-82ac-b52ccc04493d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872f33830>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35514215-a9d5-4184-bf8d-5de574a2247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:03:04 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.684s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:03:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Volume volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 (ac1b71cc-59ab-4815-bfe6-463027dd1626): created successfully
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35514215-a9d5-4184-bf8d-5de574a2247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Flow 'volume_create_manager' (4a681c29-577c-4848-a3ad-d726cdc7a20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:03:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:03:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c583e21e-4e23-459b-b515-741aad826d40 tempest-TestShelveInstance-209369895 None] Created volume successfully.
Jun 29 05:03:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:03:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:03:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eaf436-26bc-43b9-bed9-238a083facee]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:03:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:11 devstack sudo[111477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:11 devstack sudo[111477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:12 devstack sudo[111477]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.782s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:12 devstack sudo[111481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:12 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:13 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 1 in 0.722s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:03:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.550s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:03:13 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-ac1b71cc-59ab-4815-bfe6-463027dd1626', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2f29a9c-f531-4c75-9c98-77b153299dd9', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 05:03:13 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-02952cd5-2c7f-4607-8912-2d39ad81a59c req-154dbc42-5392-459f-8be5-bcee85792bc4 tempest-TestShelveInstance-209369895 None] attachment_update completed successfully.
Jun 29 05:03:23 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:INSERT=5 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:03:23 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=15,cinder:INSERT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:03:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-f179cce0-e822-41f9-8b4a-a05be9b8ad52 req-183656b8-edf1-43ca-b024-ad238dbf994f tempest-TestShelveInstance-209369895 None] Terminate volume connection completed successfully.
Jun 29 05:03:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-f179cce0-e822-41f9-8b4a-a05be9b8ad52 req-183656b8-edf1-43ca-b024-ad238dbf994f tempest-TestShelveInstance-209369895 None] Deleting attachment c2f29a9c-f531-4c75-9c98-77b153299dd9. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d57565e-0811-496b-a45d-748af4408fd2]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:55 devstack sudo[112169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:55 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:55 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.728s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:03:55 devstack sudo[112174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:03:55 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:03:56 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root
Jun 29 05:03:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 1 in 0.725s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:03:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:03:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.496s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:03:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce', 'name': 'volume-ac1b71cc-59ab-4815-bfe6-463027dd1626', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96e58232-cd8c-4505-ad98-15305dfbccf8', 'enforce_multipath': True} {{(pid=93723) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 29 05:03:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-3335b2bf-7214-4804-9429-8e7bb3d23feb req-ae165a50-1982-4053-a22a-4b36c19f61ac tempest-TestShelveInstance-209369895 None] attachment_update completed successfully.
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:04:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:03 devstack sudo[112181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:04:03 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:04 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.651s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:04:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:04:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:04:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:04:06 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:06 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:36 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-e995a05a-2956-4df1-b6f3-01460edf2e50 tempest-TestShelveInstance-209369895 None] Terminate volume connection completed successfully.
Jun 29 05:04:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-e995a05a-2956-4df1-b6f3-01460edf2e50 tempest-TestShelveInstance-209369895 None] Deleting attachment 96e58232-cd8c-4505-ad98-15305dfbccf8. {{(pid=93723) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Acquiring lock "cinder-ac1b71cc-59ab-4815-bfe6-463027dd1626-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "cinder-ac1b71cc-59ab-4815-bfe6-463027dd1626-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Acquiring lock "cinder-quobyte-ac1b71cc-59ab-4815-bfe6-463027dd1626" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "cinder-quobyte-ac1b71cc-59ab-4815-bfe6-463027dd1626" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6f19a8-6fde-4abd-8e89-c41dd23bc3ca]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:04:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:37 devstack sudo[112772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:04:37 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:38 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.734s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:38 devstack sudo[112776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:04:38 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:38 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 1 in 0.727s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:04:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:39 devstack sudo[112781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626
Jun 29 05:04:39 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:39 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-ac1b71cc-59ab-4815-bfe6-463027dd1626" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "cinder-quobyte-ac1b71cc-59ab-4815-bfe6-463027dd1626" released by "delete_volume" :: held 2.176s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG cinder.quota [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Created reservations ['944f9da4-4bb2-4c54-8db8-4bf6346f9b85', '0cc85a65-50e8-4c30-8a9b-409731949629', '28c641b1-fd00-461e-826c-1a77af85fbc5', 'eee29642-e3d3-4585-bf23-ab8a673f8696'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:04:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:39 devstack sudo[112784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:04:39 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:40 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:40 devstack cinder-volume[93723]: DEBUG cinder.manager [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:04:40 devstack cinder-volume[93723]: INFO cinder.volume.manager [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Deleted volume successfully.
Jun 29 05:04:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [req-036f29a0-a3b0-4c4a-99f3-79c0889e0f5d req-f01c2c65-29cc-4f18-84b5-9f1b493d6056 tempest-TestShelveInstance-209369895 None] Lock "cinder-ac1b71cc-59ab-4815-bfe6-463027dd1626-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:04:49 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:50 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Flow 'volume_create_manager' (d526c244-7c1b-4045-989f-1438c92d4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05863810-e0bf-4779-9255-2adc7f126544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05863810-e0bf-4779-9255-2adc7f126544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be4e91-5391-465f-a1da-9454e4af6d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de355f738753415c92196e62b503a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:04:54Z,use_quota=True,user_id='4e46152a42fb402b814c98a1fa4fa3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed9ad042-1705-4269-ac0a-8eda2215a5dd),volume_type_id=ed9ad042-1705-4269-ac0a-8eda2215a5dd)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97bc961-2a9c-4dca-b287-8c603a853b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97bc961-2a9c-4dca-b287-8c603a853b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba62f20-f62a-4e93-957b-367bb88c065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:04:53 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba62f20-f62a-4e93-957b-367bb88c065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02be4e91-5391-465f-a1da-9454e4af6d31', 'volume_name': 'volume-02be4e91-5391-465f-a1da-9454e4af6d31', 'volume_size': 1, 'image_id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88ce2d0487743da9555d4262a1da058e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de355f738753415c92196e62b503a118', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3ae6f701f3c39e1b37f7666bac3190446af01d880da12ab3efee79ae0b362683816c376dd52d08808b28bbae4406812003ecb294752630926460c2468b3246', 'id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'created_at': datetime.datetime(2026, 6, 29, 3, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4729c5f-5435-4bb7-b23e-116306c8e13f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a990>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649e025c-00c0-45f4-801b-e0db95d3b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649e025c-00c0-45f4-801b-e0db95d3b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90955348-ba9b-4f85-981b-131279e78972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:04:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Volume 02be4e91-5391-465f-a1da-9454e4af6d31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02be4e91-5391-465f-a1da-9454e4af6d31', 'volume_size': 1, 'image_id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88ce2d0487743da9555d4262a1da058e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de355f738753415c92196e62b503a118', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3ae6f701f3c39e1b37f7666bac3190446af01d880da12ab3efee79ae0b362683816c376dd52d08808b28bbae4406812003ecb294752630926460c2468b3246', 'id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'created_at': datetime.datetime(2026, 6, 29, 3, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4729c5f-5435-4bb7-b23e-116306c8e13f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a990>}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Trying to clone 02be4e91-5391-465f-a1da-9454e4af6d31 from image f4729c5f-5435-4bb7-b23e-116306c8e13f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 05:04:54 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Image download 0.00 MB at 0.00 MB/s
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c7c8ad-0d7c-4996-aabe-45fff293f0b4]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:54 devstack sudo[112803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:04:54 devstack sudo[112803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:54 devstack sudo[112803]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:55 devstack sudo[112807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:04:55 devstack sudo[112807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:55 devstack sudo[112807]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 1 in 0.695s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:04:55 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Temporary image f4729c5f-5435-4bb7-b23e-116306c8e13f is fetched for user 4e46152a42fb402b814c98a1fa4fa3af. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 05:04:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f40f36d-b205-49df-b8ba-b2c051c095c2]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:04:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:55 devstack sudo[112812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:04:55 devstack sudo[112812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:56 devstack sudo[112812]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:56 devstack sudo[112817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:04:56 devstack sudo[112817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:57 devstack sudo[112817]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 1 in 0.708s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be4e91-5391-465f-a1da-9454e4af6d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de355f738753415c92196e62b503a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:04:54Z,use_quota=True,user_id='4e46152a42fb402b814c98a1fa4fa3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed9ad042-1705-4269-ac0a-8eda2215a5dd),volume_type_id=ed9ad042-1705-4269-ac0a-8eda2215a5dd)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Creating volume 02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:04:57 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:57 devstack sudo[112822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1073741824
Jun 29 05:04:57 devstack sudo[112822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:57 devstack sudo[112822]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1073741824" returned: 0 in 0.790s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:57 devstack sudo[112828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:04:57 devstack sudo[112828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:58 devstack sudo[112828]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 0 in 0.651s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Attempting download of f4729c5f-5435-4bb7-b23e-116306c8e13f ((None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}])) to volume 02be4e91-5391-465f-a1da-9454e4af6d31. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3514e708-bbb3-4006-b825-c97f0683c294]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:04:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:58 devstack sudo[112831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs
Jun 29 05:04:58 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:04:59 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root
Jun 29 05:04:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs" returned: 0 in 0.703s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:04:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:04:59 devstack sudo[112835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs
Jun 29 05:04:59 devstack sudo[112835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:00 devstack sudo[112835]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs" returned: 1 in 0.704s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4729c5f-5435-4bb7-b23e-116306c8e13f_lxfbqcgs' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb873c9-a504-42b8-bce3-aaa3efd7a31a]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:00 devstack sudo[112839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:05:00 devstack sudo[112839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:00 devstack sudo[112839]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:00 devstack sudo[112843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD
Jun 29 05:05:00 devstack sudo[112843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:01 devstack sudo[112843]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD" returned: 1 in 0.694s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:05:01 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] f4729c5f-5435-4bb7-b23e-116306c8e13f was raw, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 05:05:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:01 devstack sudo[112851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:01 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:02 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 0 in 0.716s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4729c5f-5435-4bb7-b23e-116306c8e13f_m663m9i9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:05:02 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Converted 0.00 MB image at 0.00 MB/s
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:02 devstack sudo[112856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1G
Jun 29 05:05:02 devstack sudo[112856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:02 devstack sudo[112856]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 1G" returned: 0 in 0.653s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e481861a-cf20-4e47-b722-464e0992fd94]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:03 devstack sudo[112861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:03 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:03 devstack sudo[112863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:05:03 devstack sudo[112863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:03 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 0 in 0.725s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:03 devstack sudo[112867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:03 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:04 devstack sudo[112863]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.636s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:05:04 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 1 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Downloaded image f4729c5f-5435-4bb7-b23e-116306c8e13f ((None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}])) to volume 02be4e91-5391-465f-a1da-9454e4af6d31 successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Temporary image f4729c5f-5435-4bb7-b23e-116306c8e13f for user 4e46152a42fb402b814c98a1fa4fa3af is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Marking volume 02be4e91-5391-465f-a1da-9454e4af6d31 as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Copying metadata from image f4729c5f-5435-4bb7-b23e-116306c8e13f to 02be4e91-5391-465f-a1da-9454e4af6d31. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Creating volume glance metadata for volume 02be4e91-5391-465f-a1da-9454e4af6d31 backed by image f4729c5f-5435-4bb7-b23e-116306c8e13f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '88ce2d0487743da9555d4262a1da058e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90955348-ba9b-4f85-981b-131279e78972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02be4e91-5391-465f-a1da-9454e4af6d31', 'volume_size': 1, 'image_id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4729c5f-5435-4bb7-b23e-116306c8e13f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88ce2d0487743da9555d4262a1da058e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de355f738753415c92196e62b503a118', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6c3ae6f701f3c39e1b37f7666bac3190446af01d880da12ab3efee79ae0b362683816c376dd52d08808b28bbae4406812003ecb294752630926460c2468b3246', 'id': 'f4729c5f-5435-4bb7-b23e-116306c8e13f', 'created_at': datetime.datetime(2026, 6, 29, 3, 4, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 4, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4729c5f-5435-4bb7-b23e-116306c8e13f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a990>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25ae36e-d172-4a05-8749-db2f4f5ddc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Volume volume-02be4e91-5391-465f-a1da-9454e4af6d31 (02be4e91-5391-465f-a1da-9454e4af6d31): created successfully
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25ae36e-d172-4a05-8749-db2f4f5ddc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Flow 'volume_create_manager' (d526c244-7c1b-4045-989f-1438c92d4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1addd6e0-fdb3-45ac-8413-290b00aeebe7 tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Created volume successfully.
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Acquiring lock "cinder-02be4e91-5391-465f-a1da-9454e4af6d31-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "cinder-02be4e91-5391-465f-a1da-9454e4af6d31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Acquiring lock "cinder-quobyte-02be4e91-5391-465f-a1da-9454e4af6d31" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "cinder-quobyte-02be4e91-5391-465f-a1da-9454e4af6d31" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9aacf5-6e57-4bc0-a5e4-13e176190ad9]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:05 devstack sudo[112873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:05 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:06 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:06 devstack sudo[112878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:06 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:06 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 1 in 0.719s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:05:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:06 devstack sudo[112883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31
Jun 29 05:05:06 devstack sudo[112883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:07 devstack sudo[112883]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-02be4e91-5391-465f-a1da-9454e4af6d31" returned: 0 in 0.640s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "cinder-quobyte-02be4e91-5391-465f-a1da-9454e4af6d31" released by "delete_volume" :: held 2.148s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:07 devstack cinder-volume[93723]: WARNING cinder.quota [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 29 05:05:07 devstack cinder-volume[93723]: WARNING cinder.quota [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Created reservations ['501b69d8-9118-4c2c-bf69-96e65da314a3', 'f11a50e4-fc7a-4c9e-ac9f-cbc60dc15e3a', '75e5392d-20ff-4b55-9f18-72e078ec6b93', '7929da18-3308-47c0-bb6d-837243792cc3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:07 devstack sudo[112886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:05:07 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:08 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.624s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:08 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:05:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Deleted volume successfully.
Jun 29 05:05:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-77ae1860-e207-4923-93ed-e02500b7528e tempest-VolumeAndVolumeTypeFromImageTest-2004406397 None] Lock "cinder-02be4e91-5391-465f-a1da-9454e4af6d31-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Flow 'volume_create_manager' (9f1a1fdf-2c05-43ea-950a-8fc9796c5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b376f65-619b-4d88-aa43-ecd40984e5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b376f65-619b-4d88-aa43-ecd40984e5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde52543-2743-46d5-897c-a25da4c98c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e5dbc6c50c42019b69f2e15e02e71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:13Z,use_quota=True,user_id='d954ae5f8d63458db619946a82062725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3873d4d2-39a7-4f23-9329-c28396fce074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3873d4d2-39a7-4f23-9329-c28396fce074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5b1bed-c225-4c32-814a-ba2b08b74fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5b1bed-c225-4c32-814a-ba2b08b74fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde52543-2743-46d5-897c-a25da4c98c56', 'volume_name': 'volume-bde52543-2743-46d5-897c-a25da4c98c56', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468bdf53-5e0a-4210-bfa8-38cfe593db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468bdf53-5e0a-4210-bfa8-38cfe593db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffb123-cdea-49d0-873a-cda052edbf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Volume bde52543-2743-46d5-897c-a25da4c98c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde52543-2743-46d5-897c-a25da4c98c56', 'volume_size': 1}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde52543-2743-46d5-897c-a25da4c98c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e5dbc6c50c42019b69f2e15e02e71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:13Z,use_quota=True,user_id='d954ae5f8d63458db619946a82062725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Creating volume bde52543-2743-46d5-897c-a25da4c98c56 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:05:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:05:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:12 devstack sudo[112891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 1073741824
Jun 29 05:05:12 devstack sudo[112891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:13 devstack sudo[112891]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 1073741824" returned: 0 in 0.813s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:13 devstack sudo[112896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56
Jun 29 05:05:13 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:14 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56" returned: 0 in 0.635s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ffb123-cdea-49d0-873a-cda052edbf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde52543-2743-46d5-897c-a25da4c98c56', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76393d3e-5a3e-4b6b-81cf-e90279e84c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Volume volume-bde52543-2743-46d5-897c-a25da4c98c56 (bde52543-2743-46d5-897c-a25da4c98c56): created successfully
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76393d3e-5a3e-4b6b-81cf-e90279e84c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Flow 'volume_create_manager' (9f1a1fdf-2c05-43ea-950a-8fc9796c5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1b1df450-7595-416a-86b4-52130667b309 tempest-CinderUnicodeTest-1151383497 None] Created volume successfully.
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Flow 'volume_create_manager' (2b672a31-ad64-47e8-8d14-0f7c45010028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af347dbc-6eb7-4f14-9568-59e696ab779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af347dbc-6eb7-4f14-9568-59e696ab779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473321358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f520f992-fbe9-4c6e-9dea-1457469d4c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e5dbc6c50c42019b69f2e15e02e71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:15Z,use_quota=True,user_id='d954ae5f8d63458db619946a82062725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cee6d9-6748-4b78-9b12-1a78bc9031d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cee6d9-6748-4b78-9b12-1a78bc9031d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a80c2d-f4d3-4a0c-aaff-7b5c34abb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a80c2d-f4d3-4a0c-aaff-7b5c34abb30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f520f992-fbe9-4c6e-9dea-1457469d4c1b', 'volume_name': 'volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501a8053-eff1-461c-a7ff-ec61bfbc36ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501a8053-eff1-461c-a7ff-ec61bfbc36ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5811c8-8ca1-42fd-bcc5-993a637123d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:15 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Volume f520f992-fbe9-4c6e-9dea-1457469d4c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b', 'volume_size': 1}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473321358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f520f992-fbe9-4c6e-9dea-1457469d4c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e5dbc6c50c42019b69f2e15e02e71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:15Z,use_quota=True,user_id='d954ae5f8d63458db619946a82062725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Creating volume f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:05:15 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:05:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:15 devstack sudo[112933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b 1073741824
Jun 29 05:05:15 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:16 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b 1073741824" returned: 0 in 0.818s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:16 devstack sudo[112941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b
Jun 29 05:05:16 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:16 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b" returned: 0 in 0.664s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5811c8-8ca1-42fd-bcc5-993a637123d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc74e6b6-e011-4ce1-b7d1-4e78356cea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:16 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Volume volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b (f520f992-fbe9-4c6e-9dea-1457469d4c1b): created successfully
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc74e6b6-e011-4ce1-b7d1-4e78356cea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:16 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Flow 'volume_create_manager' (2b672a31-ad64-47e8-8d14-0f7c45010028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-275150ff-6317-4eb3-bef2-08f3e3cfc530 tempest-CinderUnicodeTest-1151383497 None] Created volume successfully.
Jun 29 05:05:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Creating offline snapshot c2eef221-70f8-4c7f-a600-cbe9e8d3b895 of volume f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:05:17 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9ed58-565f-41ee-bfb7-eee5b1931ab2]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:17 devstack sudo[112944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b
Jun 29 05:05:17 devstack sudo[112944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:18 devstack sudo[112944]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b" returned: 0 in 0.766s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:18 devstack sudo[112949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 1G
Jun 29 05:05:18 devstack sudo[112949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:19 devstack sudo[112949]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 1G" returned: 0 in 0.774s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:19 devstack sudo[112954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895
Jun 29 05:05:19 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:19 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895" returned: 0 in 0.687s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:19 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 is being set with open permissions: ugo+rw
Jun 29 05:05:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:19 devstack sudo[112959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895
Jun 29 05:05:19 devstack sudo[112959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:20 devstack sudo[112959]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895" returned: 0 in 0.635s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:20 devstack sudo[112962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info
Jun 29 05:05:20 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:21 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info" returned: 0 in 0.624s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:21 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info is being set with open permissions: ugo+rw
Jun 29 05:05:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:21 devstack sudo[112965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info
Jun 29 05:05:21 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:21 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.info" returned: 0 in 0.637s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.205s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7e7f72e9-9c39-4ec2-96db-557d8601d994 tempest-CinderUnicodeTest-1151383497 None] Create snapshot completed successfully
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-c2eef221-70f8-4c7f-a600-cbe9e8d3b895-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-c2eef221-70f8-4c7f-a600-cbe9e8d3b895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-quobyte-c2eef221-70f8-4c7f-a600-cbe9e8d3b895" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-c2eef221-70f8-4c7f-a600-cbe9e8d3b895" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Deleting offline snapshot c2eef221-70f8-4c7f-a600-cbe9e8d3b895 of volume f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] snapshot_file for this snap is: volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[529e1383-7ccf-42e3-8c5d-7f8789066a26]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:22 devstack sudo[112968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895
Jun 29 05:05:22 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:23 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:05:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf6a85-faf7-4680-a0b6-94b0429b28f0]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:23 devstack sudo[112973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b
Jun 29 05:05:23 devstack sudo[112973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:24 devstack sudo[112973]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:24 devstack sudo[112979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895
Jun 29 05:05:24 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:25 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895" returned: 0 in 0.707s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:25 devstack sudo[112984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895
Jun 29 05:05:25 devstack sudo[112984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:25 devstack sudo[112984]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b.c2eef221-70f8-4c7f-a600-cbe9e8d3b895" returned: 0 in 0.621s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-c2eef221-70f8-4c7f-a600-cbe9e8d3b895" released by "_delete_snapshot" :: held 2.912s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" released by "delete_snapshot" :: held 2.934s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Created reservations ['715c368e-8cc1-410e-938d-e904b5b20447', '733e9dd1-0fa6-470c-bb11-10cdbff15f7a', 'ddcaa7e7-77c9-4d70-9aef-4a0da60f0531', '902daa65-4711-4ec6-ab48-1359576a8341'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:05:25 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Delete snapshot completed successfully.
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-645d5d84-4c92-4e66-a631-8c75b843a0e3 tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-c2eef221-70f8-4c7f-a600-cbe9e8d3b895-delete_snapshot" released by "delete_snapshot" :: held 3.056s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-f520f992-fbe9-4c6e-9dea-1457469d4c1b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-f520f992-fbe9-4c6e-9dea-1457469d4c1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:26 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e704676f-f0a4-4730-a2c0-aab35bf93a4c]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:26 devstack sudo[112988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b
Jun 29 05:05:26 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:26 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b" returned: 0 in 0.765s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:26 devstack sudo[112993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b
Jun 29 05:05:26 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:27 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f520f992-fbe9-4c6e-9dea-1457469d4c1b" returned: 0 in 0.661s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-f520f992-fbe9-4c6e-9dea-1457469d4c1b" released by "delete_volume" :: held 1.479s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Created reservations ['cea1d953-1803-4e87-ac48-8fb324168a7d', '154e8dc4-5ee0-407b-af6f-1b76ca88e577', '40b2cb46-835d-42b6-8398-a98f9847fe02', '6c8e725c-0055-4ed4-8422-465f50823edc'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:27 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:27 devstack sudo[112996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:05:27 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-bde52543-2743-46d5-897c-a25da4c98c56-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-bde52543-2743-46d5-897c-a25da4c98c56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "cinder-quobyte-bde52543-2743-46d5-897c-a25da4c98c56" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:05:28 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-bde52543-2743-46d5-897c-a25da4c98c56" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.658s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:05:28 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Deleted volume successfully.
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d74c58-9612-4140-a31e-5e7a7be4ddc4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e4ea32e0-5034-4bdf-87c3-577ae22ab14f tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-f520f992-fbe9-4c6e-9dea-1457469d4c1b-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:28 devstack sudo[112999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56
Jun 29 05:05:28 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:28 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56" returned: 0 in 0.738s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:28 devstack sudo[113004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56
Jun 29 05:05:28 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:29 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-bde52543-2743-46d5-897c-a25da4c98c56" returned: 0 in 0.632s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-quobyte-bde52543-2743-46d5-897c-a25da4c98c56" released by "delete_volume" :: held 1.418s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Created reservations ['5cda251e-b485-44c1-8ada-52a35e1bd5df', '57ea2d24-d21c-4987-bb73-366a94c74216', '1ada5fde-de19-4aff-86a1-96cf7090393b', 'b1906e21-72d5-4a26-b0be-2f278d94c94e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:29 devstack sudo[113007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:05:29 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:30 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:30 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.633s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:30 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:05:30 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Deleted volume successfully.
Jun 29 05:05:30 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4863bf4a-2dc1-401b-8204-73b82585099b tempest-CinderUnicodeTest-1151383497 None] Lock "cinder-bde52543-2743-46d5-897c-a25da4c98c56-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:05:39 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:05:40 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=42,cinder:SELECT=30,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Flow 'volume_create_manager' (5f354593-2dfe-4dd9-a9c7-3a5a5ab941f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce042d4-04ac-4f79-b3a5-327e55a5af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce042d4-04ac-4f79-b3a5-327e55a5af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2047791462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da09bcf5-8bf6-457c-a82b-52793258eeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079975123be464dac1c9e1167d4efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:52Z,use_quota=True,user_id='2fae7aafda3f409bacaf7871a94f34c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131456e6-844f-49bd-a587-f53bb4a34f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131456e6-844f-49bd-a587-f53bb4a34f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3442b4-8955-4a07-80fc-1ab8ebd8ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3442b4-8955-4a07-80fc-1ab8ebd8ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da09bcf5-8bf6-457c-a82b-52793258eeb3', 'volume_name': 'volume-da09bcf5-8bf6-457c-a82b-52793258eeb3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cc25ed-a312-4ec5-84dd-8ae912465703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cc25ed-a312-4ec5-84dd-8ae912465703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d8b53-ac58-4fa4-9088-f9d5ccdef75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Volume da09bcf5-8bf6-457c-a82b-52793258eeb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da09bcf5-8bf6-457c-a82b-52793258eeb3', 'volume_size': 1}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2047791462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da09bcf5-8bf6-457c-a82b-52793258eeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079975123be464dac1c9e1167d4efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:05:52Z,use_quota=True,user_id='2fae7aafda3f409bacaf7871a94f34c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Creating volume da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:05:52 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:52 devstack sudo[113024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 1073741824
Jun 29 05:05:52 devstack sudo[113024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:52 devstack sudo[113024]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 1073741824" returned: 0 in 0.788s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:52 devstack sudo[113029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:05:52 devstack sudo[113029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:53 devstack sudo[113029]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.634s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d8b53-ac58-4fa4-9088-f9d5ccdef75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da09bcf5-8bf6-457c-a82b-52793258eeb3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60403dc0-a7bb-40f3-a573-19c22c0a3e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:05:53 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Volume volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 (da09bcf5-8bf6-457c-a82b-52793258eeb3): created successfully
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60403dc0-a7bb-40f3-a573-19c22c0a3e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:05:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Flow 'volume_create_manager' (5f354593-2dfe-4dd9-a9c7-3a5a5ab941f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:05:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1cbc3ae8-b8e4-4a5c-b106-27973997df02 tempest-SnapshotDependencyTests-453937325 None] Created volume successfully.
Jun 29 05:05:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:05:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:05:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Creating offline snapshot 0624215d-d3dc-4d79-9b90-9cefbb414382 of volume da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:05:54 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2122eff-9c14-409e-b3f5-4430c4744056]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:05:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:54 devstack sudo[113032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:05:54 devstack sudo[113032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:55 devstack sudo[113032]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.738s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:55 devstack sudo[113037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 1G
Jun 29 05:05:55 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:55 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 1G" returned: 0 in 0.764s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:55 devstack sudo[113044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:05:55 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:56 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.670s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:56 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 is being set with open permissions: ugo+rw
Jun 29 05:05:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:56 devstack sudo[113049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:05:56 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:57 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.627s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:57 devstack sudo[113052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info
Jun 29 05:05:57 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:57 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info" returned: 0 in 0.663s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:57 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info is being set with open permissions: ugo+rw
Jun 29 05:05:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:05:57 devstack sudo[113055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info
Jun 29 05:05:57 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:05:58 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root
Jun 29 05:05:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.info" returned: 0 in 0.625s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:05:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:05:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-23617843-1909-4e0c-bea4-b928f0133d74 tempest-SnapshotDependencyTests-453937325 None] Create snapshot completed successfully
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Flow 'volume_create_manager' (69c07740-0231-4612-8003-ee3fc10d3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e36d98-03e3-43da-90ab-b6c9c4017748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e36d98-03e3-43da-90ab-b6c9c4017748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefb4a86-b8ce-4e43-bb19-5d414e72f95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1079975123be464dac1c9e1167d4efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0624215d-d3dc-4d79-9b90-9cefbb414382,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:00Z,use_quota=True,user_id='2fae7aafda3f409bacaf7871a94f34c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6647e936-f7d7-4ba5-b8da-b145cb72d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6647e936-f7d7-4ba5-b8da-b145cb72d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42eedd80-7d48-4cd7-bc8f-3b41e6060482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42eedd80-7d48-4cd7-bc8f-3b41e6060482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eefb4a86-b8ce-4e43-bb19-5d414e72f95b', 'volume_name': 'volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b', 'volume_size': 1, 'snapshot_id': '0624215d-d3dc-4d79-9b90-9cefbb414382'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a69a809-b775-4c99-8168-053ff9e68875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a69a809-b775-4c99-8168-053ff9e68875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d769e3-d30e-4dd3-b34d-9bc2086faef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:00 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Volume eefb4a86-b8ce-4e43-bb19-5d414e72f95b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b', 'volume_size': 1, 'snapshot_id': '0624215d-d3dc-4d79-9b90-9cefbb414382'}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Creating volume eefb4a86-b8ce-4e43-bb19-5d414e72f95b from snapshot 0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] snapshot: 0624215d-d3dc-4d79-9b90-9cefbb414382, volume: eefb4a86-b8ce-4e43-bb19-5d414e72f95b,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb6898-ef5b-4caf-8055-2383f4967f20]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:00 devstack sudo[113058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:06:00 devstack sudo[113058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:00 devstack sudo[113058]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.749s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da09bcf5-8bf6-457c-a82b-52793258eeb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[32af9e89-2088-4af2-af55-159702c873d4]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:01 devstack sudo[113063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:06:01 devstack sudo[113063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:01 devstack sudo[113063]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:01 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 05:06:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:01 devstack sudo[113068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b
Jun 29 05:06:01 devstack sudo[113068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:03 devstack sudo[113080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:03 devstack sudo[113080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:04 devstack sudo[113080]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.487s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:06:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:06:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:06:06 devstack sudo[113068]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" returned: 0 in 4.514s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:06 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fb811c-7cae-4ce5-a541-601638f637ef]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:06 devstack sudo[113085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:06:06 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:07 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.922s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:06:07 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Converted 1024.00 MB image at 226.81 MB/s
Jun 29 05:06:07 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b is being set with open permissions: ugo+rw
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:07 devstack sudo[113090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b
Jun 29 05:06:07 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:07 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" returned: 0 in 0.657s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" released by "_copy_volume_from_snapshot" :: held 7.662s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" released by "_create_volume_from_snapshot" :: held 7.690s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.704s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d769e3-d30e-4dd3-b34d-9bc2086faef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b', 'volume_size': 1, 'snapshot_id': '0624215d-d3dc-4d79-9b90-9cefbb414382'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db55f51d-4470-4219-8c10-850614b5455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Volume volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b (eefb4a86-b8ce-4e43-bb19-5d414e72f95b): created successfully
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db55f51d-4470-4219-8c10-850614b5455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Flow 'volume_create_manager' (69c07740-0231-4612-8003-ee3fc10d3a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9497d368-3a06-4106-9bab-611f80575ee4 tempest-SnapshotDependencyTests-453937325 None] Created volume successfully.
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-0624215d-d3dc-4d79-9b90-9cefbb414382-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-0624215d-d3dc-4d79-9b90-9cefbb414382-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Deleting offline snapshot 0624215d-d3dc-4d79-9b90-9cefbb414382 of volume da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] snapshot_file for this snap is: volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037c78a-8525-4074-85d6-6e4c8116b124]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:08 devstack sudo[113093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:06:08 devstack sudo[113093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:09 devstack sudo[113093]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.753s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da09bcf5-8bf6-457c-a82b-52793258eeb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:06:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ee87e-ec47-43c5-b694-a795a5fb2f70]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:09 devstack sudo[113098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:06:09 devstack sudo[113098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:10 devstack sudo[113098]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.746s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:10 devstack sudo[113103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:06:10 devstack sudo[113103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:11 devstack sudo[113103]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.733s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:11 devstack sudo[113108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382
Jun 29 05:06:11 devstack sudo[113108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:11 devstack sudo[113108]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3.0624215d-d3dc-4d79-9b90-9cefbb414382" returned: 0 in 0.630s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-0624215d-d3dc-4d79-9b90-9cefbb414382" released by "_delete_snapshot" :: held 2.966s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" released by "delete_snapshot" :: held 2.988s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Created reservations ['c2bd8854-6b19-42c4-b4f2-aaf3754c1825', '070076d9-c1e7-4af6-baf4-bffdddc6ec38', '68b249e8-0729-4999-b91a-7127e3b1ab09', '855a4840-00dd-4ffe-94d1-a80c2c0f7592'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Delete snapshot completed successfully.
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-fed433ab-ddae-491e-b9b3-4c67dbee6ce1 tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-0624215d-d3dc-4d79-9b90-9cefbb414382-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-da09bcf5-8bf6-457c-a82b-52793258eeb3-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-da09bcf5-8bf6-457c-a82b-52793258eeb3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:12 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2861ac-9c5c-40f2-b8ca-c34af9209973]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:12 devstack sudo[113111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:06:12 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:12 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.759s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:12 devstack sudo[113116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3
Jun 29 05:06:12 devstack sudo[113116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:13 devstack sudo[113116]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-da09bcf5-8bf6-457c-a82b-52793258eeb3" returned: 0 in 0.643s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-da09bcf5-8bf6-457c-a82b-52793258eeb3" released by "delete_volume" :: held 1.460s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Created reservations ['8da0d0e0-a9eb-4399-85ef-8386aa50af29', '6b2a4c8b-10a8-4c8e-996b-30dee75c5b28', 'bc3a7c39-bae5-4a92-8d96-212c60e8a08a', '56a5e359-3d9a-420e-9de9-bc95641901fb'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:13 devstack sudo[113119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:13 devstack sudo[113119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-eefb4a86-b8ce-4e43-bb19-5d414e72f95b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-eefb4a86-b8ce-4e43-bb19-5d414e72f95b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:14 devstack sudo[113119]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.646s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Deleted volume successfully.
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-295d343e-63d6-40f7-9f7b-e19ca799368c tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-da09bcf5-8bf6-457c-a82b-52793258eeb3-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[92103092-17c5-4e8b-b535-2c3677d04841]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:14 devstack sudo[113122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b
Jun 29 05:06:14 devstack sudo[113122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:15 devstack sudo[113122]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" returned: 0 in 0.743s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:15 devstack sudo[113127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b
Jun 29 05:06:15 devstack sudo[113127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:15 devstack sudo[113127]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" returned: 0 in 0.635s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-quobyte-eefb4a86-b8ce-4e43-bb19-5d414e72f95b" released by "delete_volume" :: held 1.421s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Created reservations ['a1ea2373-854f-496a-b6b5-963426f292eb', 'faa49e72-041e-4f53-984a-0828b6b0ae04', '38dcea9d-9848-4a26-9f45-76c1de9c62ec', 'da95a07e-0843-42a8-ba62-202be20e28f9'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:15 devstack sudo[113167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:15 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:16 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.669s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:16 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Deleted volume successfully.
Jun 29 05:06:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-f48635f1-7159-4287-bf0e-8583dc139aed tempest-SnapshotDependencyTests-453937325 None] Lock "cinder-eefb4a86-b8ce-4e43-bb19-5d414e72f95b-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:25 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (23e951dc-435d-4efa-bf8f-c6de7188c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f98c5c-281e-4d90-a6a0-691b139be94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f98c5c-281e-4d90-a6a0-691b139be94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311078738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339afeca-4044-4e46-a823-05384ef5711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6b0e22-8992-42fd-aa67-134ffc03c389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6b0e22-8992-42fd-aa67-134ffc03c389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bba6cdc-45db-4956-af9f-82618926e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bba6cdc-45db-4956-af9f-82618926e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339afeca-4044-4e46-a823-05384ef5711b', 'volume_name': 'volume-339afeca-4044-4e46-a823-05384ef5711b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344500b5-35c3-4c4f-adde-6e17535836e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344500b5-35c3-4c4f-adde-6e17535836e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a45091d-cf52-4752-a9b8-21b81587b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume 339afeca-4044-4e46-a823-05384ef5711b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339afeca-4044-4e46-a823-05384ef5711b', 'volume_size': 1}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311078738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339afeca-4044-4e46-a823-05384ef5711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume 339afeca-4044-4e46-a823-05384ef5711b {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:35 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:35 devstack sudo[113217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b 1073741824
Jun 29 05:06:35 devstack sudo[113217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (869bf3a3-4479-4cb6-a4c9-8b67d707671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5e03ed-06eb-4a87-9193-8a061d675813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5e03ed-06eb-4a87-9193-8a061d675813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435754440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8c2f64-d92f-4084-adfe-fcdb99473ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3330d1c1-fdce-49b9-a558-a64bfde1e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3330d1c1-fdce-49b9-a558-a64bfde1e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:35 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1242ef8-b2de-4433-9486-6f7ee662e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1242ef8-b2de-4433-9486-6f7ee662e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8c2f64-d92f-4084-adfe-fcdb99473ac3', 'volume_name': 'volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b772b2-959c-4bec-b131-bd13512b7927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b772b2-959c-4bec-b131-bd13512b7927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870efa9-ce35-4bff-b3d3-f4f2fcd49a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume 1a8c2f64-d92f-4084-adfe-fcdb99473ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3', 'volume_size': 1}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (60d926ef-54fb-46a0-8050-ebf7064a4cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d671a62-a444-4862-a76a-71061625a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d671a62-a444-4862-a76a-71061625a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613286717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a222849d-9807-49d2-9c9c-f736556d6c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef5035f-bf94-469e-b15a-5791c9bb5aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef5035f-bf94-469e-b15a-5791c9bb5aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8a1986-e901-4064-8295-b98395ce8689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8a1986-e901-4064-8295-b98395ce8689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a222849d-9807-49d2-9c9c-f736556d6c07', 'volume_name': 'volume-a222849d-9807-49d2-9c9c-f736556d6c07', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5644367e-fbbf-4f4b-ba00-313afc35de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5644367e-fbbf-4f4b-ba00-313afc35de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47db8db-e1fe-4018-95db-c77642d8276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Volume a222849d-9807-49d2-9c9c-f736556d6c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a222849d-9807-49d2-9c9c-f736556d6c07', 'volume_size': 1}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (6e647562-1aef-497a-ab6c-c31dca709534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5747d71b-008b-4964-b107-9c0bf989b756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5747d71b-008b-4964-b107-9c0bf989b756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039250338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5899976-28ba-4f17-8822-57c200f99ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29528751-3a3d-4a52-a770-0926e7dc200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29528751-3a3d-4a52-a770-0926e7dc200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0e49d-0bbb-4889-99d0-cf94d874c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0e49d-0bbb-4889-99d0-cf94d874c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5899976-28ba-4f17-8822-57c200f99ed1', 'volume_name': 'volume-b5899976-28ba-4f17-8822-57c200f99ed1', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096da38c-6bc1-4cc2-9fbf-8a2b346ece88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096da38c-6bc1-4cc2-9fbf-8a2b346ece88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e114b0-2cbc-4b86-86c0-522beb537fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:36 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Volume b5899976-28ba-4f17-8822-57c200f99ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5899976-28ba-4f17-8822-57c200f99ed1', 'volume_size': 1}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:36 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (133b8459-50d0-4eb9-ba78-605fa3abce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ae16c1-3840-4662-a017-bbe0b66567fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack sudo[113217]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b 1073741824" returned: 0 in 1.168s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ae16c1-3840-4662-a017-bbe0b66567fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433151163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdc3432-9129-40d9-b419-435243423213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddef6e40-38ef-4405-ad7a-000970dd7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddef6e40-38ef-4405-ad7a-000970dd7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d41efd-08bb-4761-91cb-5f302bae5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d41efd-08bb-4761-91cb-5f302bae5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afdc3432-9129-40d9-b419-435243423213', 'volume_name': 'volume-afdc3432-9129-40d9-b419-435243423213', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e4c8d0-783a-4ea7-90ad-d53f9542dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e4c8d0-783a-4ea7-90ad-d53f9542dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777cb1e0-7d83-4faa-8aee-23653b29e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Volume afdc3432-9129-40d9-b419-435243423213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afdc3432-9129-40d9-b419-435243423213', 'volume_size': 1}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:37 devstack sudo[113223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b
Jun 29 05:06:37 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (14a69a06-ebb1-49fa-9594-24b6114787e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae91d981-8762-4744-810c-466af06c5ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae91d981-8762-4744-810c-466af06c5ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-680291342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65182afd-0b80-4919-88b3-032cbac97da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8bd9a2c-d9d4-4a82-8c0a-81210c2a4f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8bd9a2c-d9d4-4a82-8c0a-81210c2a4f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc428cd-78ac-43d5-a428-ca01c7bbe8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc428cd-78ac-43d5-a428-ca01c7bbe8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65182afd-0b80-4919-88b3-032cbac97da9', 'volume_name': 'volume-65182afd-0b80-4919-88b3-032cbac97da9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e25ed4-2021-4c3a-8d78-75fb5d9186b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e25ed4-2021-4c3a-8d78-75fb5d9186b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57513d12-8434-405c-b23d-e7e99541ec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Volume 65182afd-0b80-4919-88b3-032cbac97da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65182afd-0b80-4919-88b3-032cbac97da9', 'volume_size': 1}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (ee837b59-a689-4bc2-ac7a-b7ff359bfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a52701b-3ad1-4949-a79f-52975943fb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b" returned: 0 in 0.796s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.871s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435754440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8c2f64-d92f-4084-adfe-fcdb99473ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume 1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:37 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a52701b-3ad1-4949-a79f-52975943fb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243733819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664b50f4-1a1b-4cee-9c11-346d5261fc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:38Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack sudo[113226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 1073741824
Jun 29 05:06:37 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3129bb95-7f2e-49cb-a0fb-01c0cf3a4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3129bb95-7f2e-49cb-a0fb-01c0cf3a4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b20ada-61f9-4e8e-ac25-28b6e468a66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b20ada-61f9-4e8e-ac25-28b6e468a66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664b50f4-1a1b-4cee-9c11-346d5261fc3f', 'volume_name': 'volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d363c2f-be32-410d-a8ba-36e0f897125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d363c2f-be32-410d-a8ba-36e0f897125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41f8d19-b59e-47ab-b1fe-69f6e0724d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:37 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Volume 664b50f4-1a1b-4cee-9c11-346d5261fc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f', 'volume_size': 1}
Jun 29 05:06:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a45091d-cf52-4752-a9b8-21b81587b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339afeca-4044-4e46-a823-05384ef5711b', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77c06be-9bbb-402f-a779-908fae702faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:38 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-339afeca-4044-4e46-a823-05384ef5711b (339afeca-4044-4e46-a823-05384ef5711b): created successfully
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77c06be-9bbb-402f-a779-908fae702faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (23e951dc-435d-4efa-bf8f-c6de7188c46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:38 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3cbacdc8-7e09-4dfa-bd8b-c8b813c37ab8 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:38 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 1073741824" returned: 0 in 0.916s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:38 devstack sudo[113232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3
Jun 29 05:06:38 devstack sudo[113232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (cac25377-da7e-4c1b-9ba4-996848a3d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de21d9-8045-45ea-886c-86b7ba063a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de21d9-8045-45ea-886c-86b7ba063a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-443088874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f1c8af-c997-41c3-8c06-5d334b7791ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:39Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95751303-39cf-4bad-b9e4-75887dad76e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95751303-39cf-4bad-b9e4-75887dad76e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99120ae8-d4a3-4b4c-af99-d049a9cbd2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99120ae8-d4a3-4b4c-af99-d049a9cbd2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f1c8af-c997-41c3-8c06-5d334b7791ef', 'volume_name': 'volume-16f1c8af-c997-41c3-8c06-5d334b7791ef', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1de2314-52ad-47b0-88f6-082e62d84f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1de2314-52ad-47b0-88f6-082e62d84f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8834a5eb-512a-4464-bd70-6030c2c77040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume 16f1c8af-c997-41c3-8c06-5d334b7791ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f1c8af-c997-41c3-8c06-5d334b7791ef', 'volume_size': 1}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:39 devstack sudo[113232]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" returned: 0 in 0.788s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.428s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613286717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a222849d-9807-49d2-9c9c-f736556d6c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:36Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Creating volume a222849d-9807-49d2-9c9c-f736556d6c07 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:39 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c870efa9-ce35-4bff-b3d3-f4f2fcd49a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3599d0-9f03-4baf-be66-f04908f56b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack sudo[113235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 1073741824
Jun 29 05:06:39 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:39 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 (1a8c2f64-d92f-4084-adfe-fcdb99473ac3): created successfully
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3599d0-9f03-4baf-be66-f04908f56b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (869bf3a3-4479-4cb6-a4c9-8b67d707671e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:39 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9a5cd155-2a8d-49e9-8297-869ce1afe4d1 tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Flow 'volume_create_manager' (6be96680-aff1-4f55-a51a-f0252186454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9121360d-5d11-486e-96d7-02ea882a1a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9121360d-5d11-486e-96d7-02ea882a1a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770356ec-4207-4d25-afe9-ccf9740794b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe062ce57fcd4232831efeff8cebc74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='b95f65bf031d43b5b1d7a16dc31c4240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59123673-3e87-46a5-a94c-3305a6ca6da1),volume_type_id=59123673-3e87-46a5-a94c-3305a6ca6da1)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c004b9-3d93-422c-96a5-beb0c6e18405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c004b9-3d93-422c-96a5-beb0c6e18405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66bc8c9-03e0-4e21-a977-a24a6b1d05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:39 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (0f22765a-11e8-432a-ae09-b02e0c981e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e401d9-2fe6-4010-a387-28c02782d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e401d9-2fe6-4010-a387-28c02782d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988186844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4d18ee-060d-402c-888e-0673fd8d0dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7449c28-f413-45ed-af37-b090fb2ef8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7449c28-f413-45ed-af37-b090fb2ef8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196b908d-9156-4ede-be58-5c3f38dedcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196b908d-9156-4ede-be58-5c3f38dedcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4d18ee-060d-402c-888e-0673fd8d0dac', 'volume_name': 'volume-9f4d18ee-060d-402c-888e-0673fd8d0dac', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a55d40-2bba-4245-80c0-62274c9aa08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a55d40-2bba-4245-80c0-62274c9aa08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a3fb01-88b2-4fcd-bab0-a4f1f3652db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume 9f4d18ee-060d-402c-888e-0673fd8d0dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4d18ee-060d-402c-888e-0673fd8d0dac', 'volume_size': 1}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (de6dbb5a-eed6-40f6-a283-0d6ba4fc635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf8a57-e269-4cbc-a7d6-161b08c9f15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66bc8c9-03e0-4e21-a977-a24a6b1d05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '770356ec-4207-4d25-afe9-ccf9740794b7', 'volume_name': 'volume-770356ec-4207-4d25-afe9-ccf9740794b7', 'volume_size': 1, 'image_id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7aec2666b0aa1db6ffe17d5b4b0c2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe062ce57fcd4232831efeff8cebc74a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41c42b18b201ecf578e4ac743eede702336481b06faf1e30cd8359a3855c5b334323a21ebf902e446ab26c9a6302fcc6b822d0c0ba09d3756d87d54aaca0fc24', 'id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'created_at': datetime.datetime(2026, 6, 29, 3, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594a3974-05db-4cc5-8930-f7d0f8e9465e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd873010b30>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c79548-2bd4-4f35-8e0a-04cfa3acc06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c79548-2bd4-4f35-8e0a-04cfa3acc06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c56d02f-2b9e-4010-a5f8-b783ed8fc09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Volume 770356ec-4207-4d25-afe9-ccf9740794b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-770356ec-4207-4d25-afe9-ccf9740794b7', 'volume_size': 1, 'image_id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7aec2666b0aa1db6ffe17d5b4b0c2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe062ce57fcd4232831efeff8cebc74a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41c42b18b201ecf578e4ac743eede702336481b06faf1e30cd8359a3855c5b334323a21ebf902e446ab26c9a6302fcc6b822d0c0ba09d3756d87d54aaca0fc24', 'id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'created_at': datetime.datetime(2026, 6, 29, 3, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594a3974-05db-4cc5-8930-f7d0f8e9465e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd873010b30>}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Trying to clone 770356ec-4207-4d25-afe9-ccf9740794b7 from image 594a3974-05db-4cc5-8930-f7d0f8e9465e at location (None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaf8a57-e269-4cbc-a7d6-161b08c9f15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2123114177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d752c8-281e-41d8-8ea5-c8573055340c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f10c96d-2487-4339-9c1b-15b3177e8fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f10c96d-2487-4339-9c1b-15b3177e8fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e7cf01-5217-496f-bde4-dfff6698ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e7cf01-5217-496f-bde4-dfff6698ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d752c8-281e-41d8-8ea5-c8573055340c', 'volume_name': 'volume-64d752c8-281e-41d8-8ea5-c8573055340c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048139d6-f559-4fe0-afb5-eda84f43e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048139d6-f559-4fe0-afb5-eda84f43e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc26820-6103-47f8-9a4a-c81124ec53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume 64d752c8-281e-41d8-8ea5-c8573055340c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d752c8-281e-41d8-8ea5-c8573055340c', 'volume_size': 1}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 05:06:40 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Image download 0.00 MB at 0.00 MB/s
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (cb3dae5a-927e-4c68-bdda-f31b0da4873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c23c379-7917-4613-a4da-9b7b45b8647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6db851-ba9d-4ce1-9da9-169dd1c84c8d]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c23c379-7917-4613-a4da-9b7b45b8647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117857901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd17b1b-70a1-4e01-8441-9306c1bf43c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:41Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8631b171-5223-42cd-a4f3-e3bd0f71ed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8631b171-5223-42cd-a4f3-e3bd0f71ed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f391a-d529-4b60-950a-415e84d82d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f391a-d529-4b60-950a-415e84d82d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd17b1b-70a1-4e01-8441-9306c1bf43c8', 'volume_name': 'volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2765ff-aa7a-4cb3-af66-e632c860a301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2765ff-aa7a-4cb3-af66-e632c860a301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973dda9e-b408-485d-a429-e93284da6098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:40 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume 5fd17b1b-70a1-4e01-8441-9306c1bf43c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8', 'volume_size': 1}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:40 devstack sudo[113242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:06:40 devstack sudo[113242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:40 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 1073741824" returned: 0 in 1.234s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:41 devstack sudo[113244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07
Jun 29 05:06:41 devstack sudo[113244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (dbb54fe8-3bcc-4815-b667-5fa47412e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5410a3-5117-4d52-b268-c18a3363e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5410a3-5117-4d52-b268-c18a3363e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138225746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a497afb7-48cc-4b76-9f18-7a1aa1c29bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:41Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9e4d72-577c-4231-bb8a-f6de28477558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9e4d72-577c-4231-bb8a-f6de28477558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5f2100-5303-4df9-83f4-0ec332e9b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5f2100-5303-4df9-83f4-0ec332e9b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a497afb7-48cc-4b76-9f18-7a1aa1c29bb0', 'volume_name': 'volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8423d697-4dd7-4682-bfa6-5652be2268a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8423d697-4dd7-4682-bfa6-5652be2268a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de5ad09-ef57-43fa-98a3-b5275e7bec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume a497afb7-48cc-4b76-9f18-7a1aa1c29bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0', 'volume_size': 1}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:41 devstack sudo[113242]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:41 devstack sudo[113249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:06:41 devstack sudo[113249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:41 devstack sudo[113244]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07" returned: 0 in 0.758s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.094s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039250338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5899976-28ba-4f17-8822-57c200f99ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Creating volume b5899976-28ba-4f17-8822-57c200f99ed1 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:41 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47db8db-e1fe-4018-95db-c77642d8276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a222849d-9807-49d2-9c9c-f736556d6c07', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c277c76-3a6a-41b6-86e6-9a358fa87d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:41 devstack sudo[113252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 1073741824
Jun 29 05:06:41 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Volume volume-a222849d-9807-49d2-9c9c-f736556d6c07 (a222849d-9807-49d2-9c9c-f736556d6c07): created successfully
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c277c76-3a6a-41b6-86e6-9a358fa87d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (60d926ef-54fb-46a0-8050-ebf7064a4cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-30670843-f656-4820-9294-99926c12a30f tempest-CreateVolumesFromImageTest-1044795831 None] Created volume successfully.
Jun 29 05:06:42 devstack sudo[113249]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Temporary image 594a3974-05db-4cc5-8930-f7d0f8e9465e is fetched for user b95f65bf031d43b5b1d7a16dc31c4240. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[643434d5-1b78-4edd-a6aa-9cc0415a0e31]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:42 devstack sudo[113260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:06:42 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:42 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 1073741824" returned: 0 in 0.900s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:42 devstack sudo[113262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1
Jun 29 05:06:42 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:43 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:43 devstack sudo[113266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:06:43 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:43 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1" returned: 0 in 0.659s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.301s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433151163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdc3432-9129-40d9-b419-435243423213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Creating volume afdc3432-9129-40d9-b419-435243423213 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:43 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e114b0-2cbc-4b86-86c0-522beb537fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5899976-28ba-4f17-8822-57c200f99ed1', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed41c39-6eea-484c-a006-491957495e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:43 devstack sudo[113269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 1073741824
Jun 29 05:06:43 devstack sudo[113269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:43 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Volume volume-b5899976-28ba-4f17-8822-57c200f99ed1 (b5899976-28ba-4f17-8822-57c200f99ed1): created successfully
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed41c39-6eea-484c-a006-491957495e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (6e647562-1aef-497a-ab6c-c31dca709534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a225fc5d-0f54-4964-94a7-1743971e9a86 tempest-CreateVolumesFromImageTest-1044795831 None] Created volume successfully.
Jun 29 05:06:43 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 1 in 0.720s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:06:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:44 devstack sudo[113269]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 1073741824" returned: 0 in 0.854s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:44 devstack sudo[113279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213
Jun 29 05:06:44 devstack sudo[113279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:44 devstack sudo[113279]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.444s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-680291342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65182afd-0b80-4919-88b3-032cbac97da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:37Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Creating volume 65182afd-0b80-4919-88b3-032cbac97da9 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:44 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777cb1e0-7d83-4faa-8aee-23653b29e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdc3432-9129-40d9-b419-435243423213', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:44 devstack sudo[113283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 1073741824
Jun 29 05:06:44 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aa343e-a13b-441f-b385-f18602269aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:44 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Volume volume-afdc3432-9129-40d9-b419-435243423213 (afdc3432-9129-40d9-b419-435243423213): created successfully
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aa343e-a13b-441f-b385-f18602269aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:44 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (133b8459-50d0-4eb9-ba78-605fa3abce9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:45 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-999399ba-0979-4f3c-9fab-95c9abc96f09 tempest-CreateVolumesFromImageTest-1044795831 None] Created volume successfully.
Jun 29 05:06:45 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 1073741824" returned: 0 in 0.827s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:45 devstack sudo[113290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9
Jun 29 05:06:45 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:46 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9" returned: 0 in 0.627s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.445s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-243733819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664b50f4-1a1b-4cee-9c11-346d5261fc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d30196f4e04e869df3fb15301d97f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:38Z,use_quota=True,user_id='b18634df7bb249a9b5a9b686117dfb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Creating volume 664b50f4-1a1b-4cee-9c11-346d5261fc3f {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:46 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57513d12-8434-405c-b23d-e7e99541ec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65182afd-0b80-4919-88b3-032cbac97da9', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:46 devstack sudo[113293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f 1073741824
Jun 29 05:06:46 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c99c6a-87d1-449b-bd62-3271dbec8ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:46 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Volume volume-65182afd-0b80-4919-88b3-032cbac97da9 (65182afd-0b80-4919-88b3-032cbac97da9): created successfully
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c99c6a-87d1-449b-bd62-3271dbec8ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:46 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (14a69a06-ebb1-49fa-9594-24b6114787e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:46 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8bc2c099-39fd-454d-8e24-5385fc32d9da tempest-CreateVolumesFromImageTest-1044795831 None] Created volume successfully.
Jun 29 05:06:47 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f 1073741824" returned: 0 in 0.790s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:47 devstack sudo[113299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f
Jun 29 05:06:47 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:47 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f" returned: 0 in 0.633s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.508s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-443088874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f1c8af-c997-41c3-8c06-5d334b7791ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:39Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume 16f1c8af-c997-41c3-8c06-5d334b7791ef {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:47 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:47 devstack sudo[113302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef 1073741824
Jun 29 05:06:47 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41f8d19-b59e-47ab-b1fe-69f6e0724d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d7b916-96a4-41e0-b014-75eeff5649b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Volume volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f (664b50f4-1a1b-4cee-9c11-346d5261fc3f): created successfully
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d7b916-96a4-41e0-b014-75eeff5649b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Flow 'volume_create_manager' (ee837b59-a689-4bc2-ac7a-b7ff359bfae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:47 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5c139786-e998-4bd2-864b-862516b6ea19 tempest-CreateVolumesFromImageTest-1044795831 None] Created volume successfully.
Jun 29 05:06:48 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef 1073741824" returned: 0 in 0.805s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:48 devstack sudo[113314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef
Jun 29 05:06:48 devstack sudo[113314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-664b50f4-1a1b-4cee-9c11-346d5261fc3f-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:48 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-664b50f4-1a1b-4cee-9c11-346d5261fc3f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-quobyte-664b50f4-1a1b-4cee-9c11-346d5261fc3f" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-664b50f4-1a1b-4cee-9c11-346d5261fc3f" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece0c233-2278-4d1a-8817-2741f312c254]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:49 devstack sudo[113316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f
Jun 29 05:06:49 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:49 devstack sudo[113314]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef" returned: 0 in 0.650s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.293s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988186844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4d18ee-060d-402c-888e-0673fd8d0dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume 9f4d18ee-060d-402c-888e-0673fd8d0dac {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:49 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8834a5eb-512a-4464-bd70-6030c2c77040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f1c8af-c997-41c3-8c06-5d334b7791ef', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:49 devstack sudo[113319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac 1073741824
Jun 29 05:06:49 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f4332-5015-47b6-b245-39b6e08126ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:49 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-16f1c8af-c997-41c3-8c06-5d334b7791ef (16f1c8af-c997-41c3-8c06-5d334b7791ef): created successfully
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f4332-5015-47b6-b245-39b6e08126ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (cac25377-da7e-4c1b-9ba4-996848a3d061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:49 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e01d7722-872d-49d0-99e7-e9762a94e825 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:49 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f" returned: 0 in 0.778s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:49 devstack sudo[113324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f
Jun 29 05:06:49 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:50 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac 1073741824" returned: 0 in 0.853s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:50 devstack sudo[113330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac
Jun 29 05:06:50 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:50 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-664b50f4-1a1b-4cee-9c11-346d5261fc3f" returned: 0 in 0.706s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-664b50f4-1a1b-4cee-9c11-346d5261fc3f" released by "delete_volume" :: held 1.537s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=62,cinder:SELECT=50,cinder:INSERT=7,cinder:DELETE=4 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Created reservations ['f98f24f4-631b-4512-b6a7-6f2a931bc451', 'f84bfc7f-9a1c-418d-9cb7-aed0b7025b98', '4ad91284-0539-46e4-b508-68e1a8fed6ca', '0ce94d82-4f8f-456c-afaf-b370d16985e1'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:50 devstack sudo[113333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:50 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:50 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac" returned: 0 in 0.678s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.524s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2123114177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d752c8-281e-41d8-8ea5-c8573055340c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume 64d752c8-281e-41d8-8ea5-c8573055340c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:50 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:51 devstack sudo[113336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c 1073741824
Jun 29 05:06:51 devstack sudo[113336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a3fb01-88b2-4fcd-bab0-a4f1f3652db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4d18ee-060d-402c-888e-0673fd8d0dac', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef3fea8-ac08-4166-a13e-c3efe6ab8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:51 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-9f4d18ee-060d-402c-888e-0673fd8d0dac (9f4d18ee-060d-402c-888e-0673fd8d0dac): created successfully
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef3fea8-ac08-4166-a13e-c3efe6ab8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (0f22765a-11e8-432a-ae09-b02e0c981e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5c9b4e3c-e6a0-4c97-8c63-fe7634253e0d tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-65182afd-0b80-4919-88b3-032cbac97da9-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-65182afd-0b80-4919-88b3-032cbac97da9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-quobyte-65182afd-0b80-4919-88b3-032cbac97da9" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-65182afd-0b80-4919-88b3-032cbac97da9" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[49538fe8-1330-4df9-87e5-0041cd2bd17a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:51 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:51 devstack sudo[113339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9
Jun 29 05:06:51 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:51 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Deleted volume successfully.
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-24728239-13e5-412a-936a-fe2175a0347f tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-664b50f4-1a1b-4cee-9c11-346d5261fc3f-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:51 devstack sudo[113336]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c 1073741824" returned: 0 in 0.858s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:51 devstack sudo[113344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c
Jun 29 05:06:51 devstack sudo[113344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:52 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:52 devstack sudo[113349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9
Jun 29 05:06:52 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:52 devstack sudo[113344]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c" returned: 0 in 0.682s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.777s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117857901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd17b1b-70a1-4e01-8441-9306c1bf43c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:41Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume 5fd17b1b-70a1-4e01-8441-9306c1bf43c8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:52 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:52 devstack sudo[113352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 1073741824
Jun 29 05:06:52 devstack sudo[113352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc26820-6103-47f8-9a4a-c81124ec53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d752c8-281e-41d8-8ea5-c8573055340c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04594df4-e52d-4920-9d25-ecee3463a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:52 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-64d752c8-281e-41d8-8ea5-c8573055340c (64d752c8-281e-41d8-8ea5-c8573055340c): created successfully
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04594df4-e52d-4920-9d25-ecee3463a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (de6dbb5a-eed6-40f6-a283-0d6ba4fc635e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:52 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f440cc69-0027-4294-bf53-93d08c2e63a6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:52 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-65182afd-0b80-4919-88b3-032cbac97da9" returned: 0 in 0.711s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-65182afd-0b80-4919-88b3-032cbac97da9" released by "delete_volume" :: held 1.546s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Created reservations ['44fb42e2-6d09-4e28-9deb-3d9872f107c9', '9328b038-896d-4083-ae6e-669d4013b26d', '3578b15f-8308-4d81-86ee-0affb50e4ba0', 'd735dd17-3c5c-4dff-bc14-55e5ee2963ff'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:52 devstack sudo[113355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:52 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-afdc3432-9129-40d9-b419-435243423213-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:53 devstack sudo[113352]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 1073741824" returned: 0 in 0.880s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-afdc3432-9129-40d9-b419-435243423213-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-quobyte-afdc3432-9129-40d9-b419-435243423213" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:53 devstack sudo[113362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8
Jun 29 05:06:53 devstack sudo[113362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-afdc3432-9129-40d9-b419-435243423213" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece5866c-d85f-41a1-8396-cafb80e1be55]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:53 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.706s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Deleted volume successfully.
Jun 29 05:06:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6157f99f-b95e-43e9-b215-4b6ed0e11b87 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-65182afd-0b80-4919-88b3-032cbac97da9-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:53 devstack sudo[113364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213
Jun 29 05:06:53 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:54 devstack sudo[113362]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" returned: 0 in 0.656s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.056s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138225746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a497afb7-48cc-4b76-9f18-7a1aa1c29bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbf0d05db74b44ac76a30004a833b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:41Z,use_quota=True,user_id='be1f0660d0f6432790bcd5986170bf99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Creating volume a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:06:54 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973dda9e-b408-485d-a429-e93284da6098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:54 devstack sudo[113367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 1073741824
Jun 29 05:06:54 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e938b8-6f06-4774-bf14-99c7d6fd21ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:54 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 (5fd17b1b-70a1-4e01-8441-9306c1bf43c8): created successfully
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e938b8-6f06-4774-bf14-99c7d6fd21ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (cb3dae5a-927e-4c68-bdda-f31b0da4873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:54 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7608c14e-2c47-4335-a381-f13e949f20e6 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:54 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213" returned: 0 in 0.786s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:54 devstack sudo[113373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213
Jun 29 05:06:54 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:55 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-afdc3432-9129-40d9-b419-435243423213" returned: 0 in 0.641s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:55 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 1073741824" returned: 0 in 0.832s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-afdc3432-9129-40d9-b419-435243423213" released by "delete_volume" :: held 1.478s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:55 devstack sudo[113381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0
Jun 29 05:06:55 devstack sudo[113381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Created reservations ['e50597a3-1fe0-4d5a-bcf8-a0c6a813521c', '1c292aa5-17ae-4e46-add8-c4ab41899935', '8a93a8e9-7b62-42a4-b225-28da1f116904', '836667e5-376c-4909-a1f5-7e3bdfcae02c'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:55 devstack sudo[113383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:55 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-b5899976-28ba-4f17-8822-57c200f99ed1-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-b5899976-28ba-4f17-8822-57c200f99ed1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-quobyte-b5899976-28ba-4f17-8822-57c200f99ed1" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-b5899976-28ba-4f17-8822-57c200f99ed1" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b78548-b332-4a55-ae68-4e9fe310a974]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:55 devstack sudo[113381]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" returned: 0 in 0.731s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.650s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de5ad09-ef57-43fa-98a3-b5275e7bec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3915c5e-f87d-4aa3-805f-838d2dbb0220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating offline snapshot 614f9cae-c0d7-4586-93bb-82febca74566 of volume 1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:06:55 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Volume volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 (a497afb7-48cc-4b76-9f18-7a1aa1c29bb0): created successfully
Jun 29 05:06:55 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3915c5e-f87d-4aa3-805f-838d2dbb0220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Flow 'volume_create_manager' (dbb54fe8-3bcc-4815-b667-5fa47412e0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7898c92-3ead-4c1b-be6b-2a967d1f6532]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.679s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Deleted volume successfully.
Jun 29 05:06:55 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-dd6efe3f-52e6-4755-b2b6-4dc8dc616a58 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created volume successfully.
Jun 29 05:06:55 devstack sudo[113388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1
Jun 29 05:06:55 devstack sudo[113388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:55 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-bdbd2787-8503-4959-893f-3e1c0c7c19b8 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-afdc3432-9129-40d9-b419-435243423213-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:55 devstack sudo[113389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3
Jun 29 05:06:55 devstack sudo[113389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c92bb-a48a-4cb3-b452-0aee85339c50]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:56 devstack sudo[113392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0
Jun 29 05:06:56 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:56 devstack sudo[113388]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1" returned: 0 in 0.854s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:56 devstack sudo[113400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1
Jun 29 05:06:56 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:56 devstack sudo[113389]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" returned: 0 in 0.828s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:56 devstack sudo[113402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 1G
Jun 29 05:06:56 devstack sudo[113402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:57 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" returned: 0 in 0.808s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:57 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b5899976-28ba-4f17-8822-57c200f99ed1" returned: 0 in 0.651s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:57 devstack sudo[113410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0
Jun 29 05:06:57 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-b5899976-28ba-4f17-8822-57c200f99ed1" released by "delete_volume" :: held 1.552s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Created reservations ['55875b0b-2845-4b8d-9b77-f93e653d1b69', '358e9b6f-fde7-4515-8ea0-a27af6e7b8fe', '752eb6b6-51fb-4486-949b-f45e1f275546', '7d685f2d-4c30-4988-b2b3-f53f125b8986'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:57 devstack sudo[113414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:57 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:57 devstack sudo[113402]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 1G" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:57 devstack sudo[113416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566
Jun 29 05:06:57 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-a222849d-9807-49d2-9c9c-f736556d6c07-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-a222849d-9807-49d2-9c9c-f736556d6c07-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:57 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" returned: 0 in 0.716s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0" released by "delete_volume" :: held 1.587s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "cinder-quobyte-a222849d-9807-49d2-9c9c-f736556d6c07" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-a222849d-9807-49d2-9c9c-f736556d6c07" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629d3f6-312b-41ca-8ef1-55af0d0588cf]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['fc0c6a87-e3db-42a4-887a-f85d69c57bf6', 'c211748f-7ab0-4c3a-900c-0d681257368e', 'c7bb1ecd-3849-4c12-8798-0d1b7b943453', 'c4162d5d-17fd-4fd7-b081-87622cf9cd91'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:58 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.711s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Deleted volume successfully.
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-825acc5e-4652-44d4-a19b-a698ce8fe9cd tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-b5899976-28ba-4f17-8822-57c200f99ed1-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:58 devstack sudo[113420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07
Jun 29 05:06:58 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:58 devstack sudo[113421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:58 devstack sudo[113421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:58 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566" returned: 0 in 0.819s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:58 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 is being set with open permissions: ugo+rw
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:58 devstack sudo[113427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566
Jun 29 05:06:58 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-5fd17b1b-70a1-4e01-8441-9306c1bf43c8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-5fd17b1b-70a1-4e01-8441-9306c1bf43c8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951038a-3067-47b2-b785-b81ae2101414]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:58 devstack sudo[113429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8
Jun 29 05:06:58 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:58 devstack sudo[113421]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.737s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:58 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:06:58 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:06:58 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07" returned: 0 in 0.904s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-573c69de-1655-4d49-94e3-6dffa1b38d39 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-a497afb7-48cc-4b76-9f18-7a1aa1c29bb0-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:59 devstack sudo[113436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07
Jun 29 05:06:59 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:59 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566" returned: 0 in 0.751s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:59 devstack sudo[113438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info
Jun 29 05:06:59 devstack sudo[113438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:59 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" returned: 0 in 0.780s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:59 devstack sudo[113444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8
Jun 29 05:06:59 devstack sudo[113444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:59 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a222849d-9807-49d2-9c9c-f736556d6c07" returned: 0 in 0.653s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-quobyte-a222849d-9807-49d2-9c9c-f736556d6c07" released by "delete_volume" :: held 1.611s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Created reservations ['189806d3-5498-4890-bb64-56659c892643', 'e3742a82-e1f8-4d7a-8d3f-a1d5bfab7291', '6a3415dc-39f6-4f3c-af4b-be4e4431316a', 'cfedd87e-2a90-4504-a69e-4fc40d635f7d'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:59 devstack sudo[113447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:06:59 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:06:59 devstack sudo[113438]: pam_unix(sudo:session): session closed for user root
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info" returned: 0 in 0.749s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:06:59 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info is being set with open permissions: ugo+rw
Jun 29 05:06:59 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:06:59 devstack sudo[113449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info
Jun 29 05:06:59 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:00 devstack sudo[113444]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" returned: 0 in 0.685s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-5fd17b1b-70a1-4e01-8441-9306c1bf43c8" released by "delete_volume" :: held 1.526s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['84b91c15-b6c6-4877-a9fa-0db63d1f7e08', 'ed7ae1ea-c8a2-4c3f-8d03-185f8caf077e', '4f038e86-59ab-4006-98a3-b80402480c9a', '8857012f-40ed-493a-ad57-ff28e1130cf9'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:00 devstack sudo[113453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:00 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:00 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.741s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:00 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Deleted volume successfully.
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-4d5d9156-c437-430d-aa34-7922f1193bd9 tempest-CreateVolumesFromImageTest-1044795831 None] Lock "cinder-a222849d-9807-49d2-9c9c-f736556d6c07-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:00 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.info" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.805s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770356ec-4207-4d25-afe9-ccf9740794b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe062ce57fcd4232831efeff8cebc74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:06:40Z,use_quota=True,user_id='b95f65bf031d43b5b1d7a16dc31c4240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59123673-3e87-46a5-a94c-3305a6ca6da1),volume_type_id=59123673-3e87-46a5-a94c-3305a6ca6da1)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Creating volume 770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:00 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:00 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:00 devstack sudo[113456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1073741824
Jun 29 05:07:00 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:00 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2997f11c-3c89-48bf-88ef-21a153da8c40 tempest-CreateVolumesFromSnapshotTest-420006839 None] Create snapshot completed successfully
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-64d752c8-281e-41d8-8ea5-c8573055340c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-64d752c8-281e-41d8-8ea5-c8573055340c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-64d752c8-281e-41d8-8ea5-c8573055340c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-64d752c8-281e-41d8-8ea5-c8573055340c" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122f577-e2a8-4b4c-b436-165454279fc1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:01 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.832s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:01 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:07:01 devstack sudo[113459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c
Jun 29 05:07:01 devstack sudo[113459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3695260a-1e96-4da1-9663-4ea0e99f1b14 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-5fd17b1b-70a1-4e01-8441-9306c1bf43c8-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (ed44fc1f-94b7-412b-9077-6b156916dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3aae828-eb94-4697-80f1-cf8a438689c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3aae828-eb94-4697-80f1-cf8a438689c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238926276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9457419f-1ce2-4db0-b212-8ef4c19db309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:02Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d13f8c-17e4-4ea5-8267-445d144faa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d13f8c-17e4-4ea5-8267-445d144faa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3c89c-1c1f-4f02-9185-9096736c13b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3c89c-1c1f-4f02-9185-9096736c13b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9457419f-1ce2-4db0-b212-8ef4c19db309', 'volume_name': 'volume-9457419f-1ce2-4db0-b212-8ef4c19db309', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8248daed-bcda-49b5-8d0f-a765ae31afb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8248daed-bcda-49b5-8d0f-a765ae31afb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a1d3c-8aeb-4153-acf8-890b22bcb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:01 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume 9457419f-1ce2-4db0-b212-8ef4c19db309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9457419f-1ce2-4db0-b212-8ef4c19db309', 'volume_size': 1}
Jun 29 05:07:01 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:02 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1073741824" returned: 0 in 1.504s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:02 devstack sudo[113469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:02 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:02 devstack sudo[113459]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c" returned: 0 in 1.178s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:02 devstack sudo[113471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c
Jun 29 05:07:02 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (bbe9352a-7223-4e0b-873b-8a503bc77fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dbffe-db31-4612-8985-6fc4a0e95467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dbffe-db31-4612-8985-6fc4a0e95467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564012244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ef3d6b-8fbf-4ead-80a1-1327cca46a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:02Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a023bb03-4d69-4b26-b0b5-8f839921f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a023bb03-4d69-4b26-b0b5-8f839921f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e139bd36-7178-44ec-90a3-8c198afa5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e139bd36-7178-44ec-90a3-8c198afa5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ef3d6b-8fbf-4ead-80a1-1327cca46a88', 'volume_name': 'volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d335a94b-59ff-4741-9cd9-f42d73d8bd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d335a94b-59ff-4741-9cd9-f42d73d8bd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a17c7e-1f79-46a8-99cd-3916bcb67744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:02 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume f0ef3d6b-8fbf-4ead-80a1-1327cca46a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88', 'volume_size': 1}
Jun 29 05:07:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (7c6b324d-b1df-4ab8-8bff-f5dce9246dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1b44e-da9a-4540-992d-0da6438950eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1b44e-da9a-4540-992d-0da6438950eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203494473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631ebc7b-6f92-418c-b6c7-124cc229099c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:03Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efd4c43-689e-4c30-94db-239d4a2e2c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efd4c43-689e-4c30-94db-239d4a2e2c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c930d0-271e-43fc-896a-4a10722de18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c930d0-271e-43fc-896a-4a10722de18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631ebc7b-6f92-418c-b6c7-124cc229099c', 'volume_name': 'volume-631ebc7b-6f92-418c-b6c7-124cc229099c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd256b-acf9-42b5-9cae-ae8963139eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd256b-acf9-42b5-9cae-ae8963139eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ba6470-bf99-4ceb-b7e6-70a83610a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume 631ebc7b-6f92-418c-b6c7-124cc229099c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631ebc7b-6f92-418c-b6c7-124cc229099c', 'volume_size': 1}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 0 in 0.924s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238926276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9457419f-1ce2-4db0-b212-8ef4c19db309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:02Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume 9457419f-1ce2-4db0-b212-8ef4c19db309 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:03 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Attempting download of 594a3974-05db-4cc5-8930-f7d0f8e9465e ((None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}])) to volume 770356ec-4207-4d25-afe9-ccf9740794b7. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 05:07:03 devstack sudo[113474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 1073741824
Jun 29 05:07:03 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[52109643-62ca-40ec-83ef-26be422e5740]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:03 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-64d752c8-281e-41d8-8ea5-c8573055340c" returned: 0 in 1.141s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:03 devstack sudo[113478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:03 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:03 devstack sudo[113477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1
Jun 29 05:07:03 devstack sudo[113477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (de02fde7-7b5d-49d2-ba6d-e10f558dc20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f49a970-1a5e-4d95-ab0d-3464708a94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-64d752c8-281e-41d8-8ea5-c8573055340c" released by "delete_volume" :: held 2.480s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f49a970-1a5e-4d95-ab0d-3464708a94d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1604690271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70afeef-c527-4254-9b50-4edb0299f8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:03Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bc2654-c403-4103-8d4f-e3ca9780fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bc2654-c403-4103-8d4f-e3ca9780fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d8c90-a9d1-4710-9067-eeb8ae669cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d8c90-a9d1-4710-9067-eeb8ae669cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70afeef-c527-4254-9b50-4edb0299f8bd', 'volume_name': 'volume-b70afeef-c527-4254-9b50-4edb0299f8bd', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16756b83-8a26-465e-9ad2-2d0f8430b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16756b83-8a26-465e-9ad2-2d0f8430b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9ed8e0-d78f-4553-a5ef-a7f26a6ea8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume b70afeef-c527-4254-9b50-4edb0299f8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70afeef-c527-4254-9b50-4edb0299f8bd', 'volume_size': 1}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['f3f44d76-a5a9-47b7-ac2f-0678b518d40a', '765af520-18e2-46b6-ad82-442af0b91b68', 'dac03be4-0765-427a-b21e-7f83aafde8f4', '42152df7-9173-46fa-bd62-ca900590ae27'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (604563c9-3e34-434a-8634-336dd64c6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75185c3-74b1-454c-82fc-6f58417ba09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:03 devstack sudo[113481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:03 devstack sudo[113481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:03 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75185c3-74b1-454c-82fc-6f58417ba09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446507802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbac647a-735d-42c4-ad30-25ac9386e1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:04Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b95c875-db11-43c7-a906-94d8f6f84da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b95c875-db11-43c7-a906-94d8f6f84da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54e1664-a502-4fa4-b0c0-bb1e59274a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54e1664-a502-4fa4-b0c0-bb1e59274a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbac647a-735d-42c4-ad30-25ac9386e1c4', 'volume_name': 'volume-cbac647a-735d-42c4-ad30-25ac9386e1c4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4604a97a-edde-41fd-abba-28f1d33e8f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4604a97a-edde-41fd-abba-28f1d33e8f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af57468d-5e30-4657-8b31-4b131145ec96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume cbac647a-735d-42c4-ad30-25ac9386e1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbac647a-735d-42c4-ad30-25ac9386e1c4', 'volume_size': 1}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:04 devstack sudo[113477]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1" returned: 0 in 1.045s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-9f4d18ee-060d-402c-888e-0673fd8d0dac-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-9f4d18ee-060d-402c-888e-0673fd8d0dac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-9f4d18ee-060d-402c-888e-0673fd8d0dac" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-9f4d18ee-060d-402c-888e-0673fd8d0dac" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:04 devstack sudo[113489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1
Jun 29 05:07:04 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2759d831-633c-481f-bb6e-407482f95f26]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:04 devstack sudo[113481]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:04 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Flow 'volume_create_manager' (02be3460-db65-402b-9fc7-893e20200003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:04 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208e0c3e-7d3c-4bf0-9969-03ec9046ff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 1073741824" returned: 0 in 1.696s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.418s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.942s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208e0c3e-7d3c-4bf0-9969-03ec9046ff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1176410580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe2ff76-e98d-4954-b00b-8f25b8d0e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dce3d735e8648bfa914323844764fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:05Z,use_quota=True,user_id='e1c09af0dec046e4b874b090b7351717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack sudo[113493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac
Jun 29 05:07:04 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385862c4-46fd-4907-8e8c-c6bececffcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385862c4-46fd-4907-8e8c-c6bececffcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb3dfd-e0fa-46e1-aab1-02fd587606cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb3dfd-e0fa-46e1-aab1-02fd587606cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe2ff76-e98d-4954-b00b-8f25b8d0e559', 'volume_name': 'volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834088ac-3ac6-41fb-9775-7fc319faf7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834088ac-3ac6-41fb-9775-7fc319faf7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410785bb-6553-4432-82f1-8739ea3a27ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Volume 6fe2ff76-e98d-4954-b00b-8f25b8d0e559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559', 'volume_size': 1}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 28 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:07:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:07:05 devstack sudo[113495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309
Jun 29 05:07:05 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-cec1ac09-962a-48a3-9202-485d98bc9123 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-64d752c8-281e-41d8-8ea5-c8573055340c-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:05 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1" returned: 1 in 0.952s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594a3974-05db-4cc5-8930-f7d0f8e9465e_7h57z0p1' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[1832b525-9059-4e1c-a14d-10dd8fcd0172]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:05 devstack sudo[113499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:07:05 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:05 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac" returned: 0 in 0.930s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:05 devstack sudo[113505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac
Jun 29 05:07:05 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:05 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309" returned: 0 in 0.720s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564012244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ef3d6b-8fbf-4ead-80a1-1327cca46a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:02Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:05 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:05 devstack sudo[113507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 1073741824
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a1d3c-8aeb-4153-acf8-890b22bcb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9457419f-1ce2-4db0-b212-8ef4c19db309', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:05 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8caca7d-c129-4776-ae9e-75a417961107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:05 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-9457419f-1ce2-4db0-b212-8ef4c19db309 (9457419f-1ce2-4db0-b212-8ef4c19db309): created successfully
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8caca7d-c129-4776-ae9e-75a417961107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:05 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (ed44fc1f-94b7-412b-9077-6b156916dafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:05 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-bd8269fb-b532-42ce-b738-a82b7ea7d8bc tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:07:06 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:06 devstack sudo[113512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD
Jun 29 05:07:06 devstack sudo[113512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:06 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9f4d18ee-060d-402c-888e-0673fd8d0dac" returned: 0 in 0.705s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-9f4d18ee-060d-402c-888e-0673fd8d0dac" released by "delete_volume" :: held 1.705s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['043ff7fe-0327-49a7-a9be-c2fce24dc52f', '01091830-0bd5-4e65-9ea5-6cd9fdcc1bea', '85014cf4-090b-42d9-acf3-0f6ffc697ec0', 'cf0d90fc-bacc-4d98-bd64-0b4dcde7a7be'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:06 devstack sudo[113519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:06 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:06 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 1073741824" returned: 0 in 0.902s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:06 devstack sudo[113521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88
Jun 29 05:07:06 devstack sudo[113521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-16f1c8af-c997-41c3-8c06-5d334b7791ef-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-16f1c8af-c997-41c3-8c06-5d334b7791ef-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-16f1c8af-c997-41c3-8c06-5d334b7791ef" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-16f1c8af-c997-41c3-8c06-5d334b7791ef" acquired by "delete_volume" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:06 devstack sudo[113512]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD" returned: 1 in 0.795s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] 594a3974-05db-4cc5-8930-f7d0f8e9465e was raw, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 05:07:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e2c5f-3036-4987-a1b1-e4c2801b21b3]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:07 devstack sudo[113526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:07 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:07 devstack sudo[113527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef
Jun 29 05:07:07 devstack sudo[113527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:07 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.763s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-12b1755d-1e4d-43b6-b82f-48b61c777a18 tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-9f4d18ee-060d-402c-888e-0673fd8d0dac-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:07 devstack sudo[113521]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" returned: 0 in 0.790s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.268s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203494473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631ebc7b-6f92-418c-b6c7-124cc229099c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:03Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume 631ebc7b-6f92-418c-b6c7-124cc229099c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:07 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a17c7e-1f79-46a8-99cd-3916bcb67744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaba278-8a34-4cba-94ab-15086a812011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:07 devstack sudo[113532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c 1073741824
Jun 29 05:07:07 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:07 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 (f0ef3d6b-8fbf-4ead-80a1-1327cca46a88): created successfully
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaba278-8a34-4cba-94ab-15086a812011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (bbe9352a-7223-4e0b-873b-8a503bc77fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:07 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6603dce1-6c9e-4d01-91ce-3024257fe20f tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:07:07 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 0 in 0.827s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594a3974-05db-4cc5-8930-f7d0f8e9465e_zhbidmmhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:07:07 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Converted 0.00 MB image at 0.00 MB/s
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:07 devstack sudo[113540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1G
Jun 29 05:07:07 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:07 devstack sudo[113527]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef" returned: 0 in 0.897s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:07 devstack sudo[113542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef
Jun 29 05:07:07 devstack sudo[113542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:08 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c 1073741824" returned: 0 in 0.935s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:08 devstack sudo[113550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c
Jun 29 05:07:08 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:08 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 1G" returned: 0 in 0.730s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a05e5c-e35e-40a9-824b-294d29cd2ba3]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:08 devstack sudo[113542]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-16f1c8af-c997-41c3-8c06-5d334b7791ef" returned: 0 in 0.698s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-16f1c8af-c997-41c3-8c06-5d334b7791ef" released by "delete_volume" :: held 1.668s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['640174d9-6dff-4bd5-9a86-c810198b074e', '669adf8d-9444-4cec-9b04-cc9377fed168', '6d1ad1b6-5457-48ac-955f-a2f72c807750', '837b13a8-85f4-4d4f-80d8-dc46eee921cb'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:08 devstack sudo[113553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:08 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:08 devstack sudo[113555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:08 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-339afeca-4044-4e46-a823-05384ef5711b-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-339afeca-4044-4e46-a823-05384ef5711b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "cinder-quobyte-339afeca-4044-4e46-a823-05384ef5711b" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-339afeca-4044-4e46-a823-05384ef5711b" acquired by "delete_volume" :: waited 0.028s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:09 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c" returned: 0 in 0.779s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1604690271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70afeef-c527-4254-9b50-4edb0299f8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:03Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume b70afeef-c527-4254-9b50-4edb0299f8bd {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:09 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca76c5-eb85-4129-9774-0919dcae6059]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:09 devstack sudo[113558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd 1073741824
Jun 29 05:07:09 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ba6470-bf99-4ceb-b7e6-70a83610a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631ebc7b-6f92-418c-b6c7-124cc229099c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f162773-0723-4887-9b9b-92de2b46ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:09 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-631ebc7b-6f92-418c-b6c7-124cc229099c (631ebc7b-6f92-418c-b6c7-124cc229099c): created successfully
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f162773-0723-4887-9b9b-92de2b46ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (7c6b324d-b1df-4ab8-8bff-f5dce9246dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-682a76a3-3fc3-4a30-8204-a26e1e444d10 tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:07:09 devstack sudo[113560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b
Jun 29 05:07:09 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:09 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 0 in 0.858s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:09 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:09 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:07:09 devstack sudo[113565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:09 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-97ce4f6f-9efb-4bf8-8372-8f4d159e18ea tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-16f1c8af-c997-41c3-8c06-5d334b7791ef-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:10 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b" returned: 0 in 0.871s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:10 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd 1073741824" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:10 devstack sudo[113575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b
Jun 29 05:07:10 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:10 devstack sudo[113579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd
Jun 29 05:07:10 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:10 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 1 in 0.835s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Downloaded image 594a3974-05db-4cc5-8930-f7d0f8e9465e ((None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}])) to volume 770356ec-4207-4d25-afe9-ccf9740794b7 successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Temporary image 594a3974-05db-4cc5-8930-f7d0f8e9465e for user b95f65bf031d43b5b1d7a16dc31c4240 is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Marking volume 770356ec-4207-4d25-afe9-ccf9740794b7 as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Copying metadata from image 594a3974-05db-4cc5-8930-f7d0f8e9465e to 770356ec-4207-4d25-afe9-ccf9740794b7. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Creating volume glance metadata for volume 770356ec-4207-4d25-afe9-ccf9740794b7 backed by image 594a3974-05db-4cc5-8930-f7d0f8e9465e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd7aec2666b0aa1db6ffe17d5b4b0c2a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c56d02f-2b9e-4010-a5f8-b783ed8fc09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770356ec-4207-4d25-afe9-ccf9740794b7', 'volume_size': 1, 'image_id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594a3974-05db-4cc5-8930-f7d0f8e9465e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7aec2666b0aa1db6ffe17d5b4b0c2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe062ce57fcd4232831efeff8cebc74a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '41c42b18b201ecf578e4ac743eede702336481b06faf1e30cd8359a3855c5b334323a21ebf902e446ab26c9a6302fcc6b822d0c0ba09d3756d87d54aaca0fc24', 'id': '594a3974-05db-4cc5-8930-f7d0f8e9465e', 'created_at': datetime.datetime(2026, 6, 29, 3, 6, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594a3974-05db-4cc5-8930-f7d0f8e9465e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd873010b30>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365b884d-cc27-41b9-a644-87b6ff8f500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Volume volume-770356ec-4207-4d25-afe9-ccf9740794b7 (770356ec-4207-4d25-afe9-ccf9740794b7): created successfully
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365b884d-cc27-41b9-a644-87b6ff8f500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Flow 'volume_create_manager' (6be96680-aff1-4f55-a51a-f0252186454b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:10 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4a4672f4-fb5d-4432-84ce-15d8805f1df3 tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Created volume successfully.
Jun 29 05:07:10 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-339afeca-4044-4e46-a823-05384ef5711b" returned: 0 in 0.666s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-quobyte-339afeca-4044-4e46-a823-05384ef5711b" released by "delete_volume" :: held 1.636s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Acquiring lock "cinder-770356ec-4207-4d25-afe9-ccf9740794b7-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:10 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd" returned: 0 in 0.688s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "cinder-770356ec-4207-4d25-afe9-ccf9740794b7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.818s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446507802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbac647a-735d-42c4-ad30-25ac9386e1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c91c461f45f7a35a6a608703cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:04Z,use_quota=True,user_id='27caad368cd64ccdb9ab390494f5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Creating volume cbac647a-735d-42c4-ad30-25ac9386e1c4 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:10 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Created reservations ['eeddddb9-7246-4e12-aa19-40d8ec964ee0', '577780ef-119a-4ef1-8d23-9c7fe65a9c03', '901aee8a-ee08-4bc9-80de-af1ace4c3846', '244ef5f4-2289-4011-b6b2-bd29a170b5b9'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:10 devstack sudo[113583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 1073741824
Jun 29 05:07:10 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9ed8e0-d78f-4553-a5ef-a7f26a6ea8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70afeef-c527-4254-9b50-4edb0299f8bd', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a526c42-c25d-4da0-869f-ebaed5757eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:10 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-b70afeef-c527-4254-9b50-4edb0299f8bd (b70afeef-c527-4254-9b50-4edb0299f8bd): created successfully
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a526c42-c25d-4da0-869f-ebaed5757eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:10 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (de02fde7-7b5d-49d2-ba6d-e10f558dc20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-437d7fd5-a1a1-4037-b208-703c85d2df2d tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Acquiring lock "cinder-quobyte-770356ec-4207-4d25-afe9-ccf9740794b7" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "cinder-quobyte-770356ec-4207-4d25-afe9-ccf9740794b7" acquired by "delete_volume" :: waited 0.033s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee13dc7-a223-47e2-bea2-c7ec5140b276]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:11 devstack sudo[113585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:11 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:11 devstack sudo[113586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:11 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:11 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 1073741824" returned: 0 in 0.911s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:11 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:11 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Deleted volume successfully.
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6720d45b-cd38-4731-a654-0d91b5d25b1b tempest-CreateVolumesFromSourceVolumeTest-1759487018 None] Lock "cinder-339afeca-4044-4e46-a823-05384ef5711b-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:11 devstack sudo[113596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4
Jun 29 05:07:11 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:12 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 0 in 0.916s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:12 devstack sudo[113598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:12 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:12 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4" returned: 0 in 0.760s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.671s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1176410580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe2ff76-e98d-4954-b00b-8f25b8d0e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dce3d735e8648bfa914323844764fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:05Z,use_quota=True,user_id='e1c09af0dec046e4b874b090b7351717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Creating volume 6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:12 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af57468d-5e30-4657-8b31-4b131145ec96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbac647a-735d-42c4-ad30-25ac9386e1c4', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:12 devstack sudo[113601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 1073741824
Jun 29 05:07:12 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c69e6d-1794-46a1-9e29-663a16aec9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:12 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Volume volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 (cbac647a-735d-42c4-ad30-25ac9386e1c4): created successfully
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c69e6d-1794-46a1-9e29-663a16aec9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Flow 'volume_create_manager' (604563c9-3e34-434a-8634-336dd64c6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-9630337b-2c1f-488d-a6d1-c43b38690ccf tempest-CreateVolumesFromSnapshotTest-420006839 None] Created volume successfully.
Jun 29 05:07:12 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 1 in 0.926s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:12 devstack sudo[113606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7
Jun 29 05:07:12 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:13 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 1073741824" returned: 0 in 0.920s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:13 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-770356ec-4207-4d25-afe9-ccf9740794b7" returned: 0 in 0.678s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:13 devstack sudo[113612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:13 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "cinder-quobyte-770356ec-4207-4d25-afe9-ccf9740794b7" released by "delete_volume" :: held 2.593s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Created reservations ['aede4df9-cd32-498f-bfa5-6edc7208f941', 'fb979f97-d194-4408-bb46-48605d819631', '0e8a9ee8-b1a0-4e75-9a2c-b14e826ce3fb', '40556460-4918-44ef-bba1-08a41e790b87'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:13 devstack sudo[113614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:13 devstack sudo[113614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-cbac647a-735d-42c4-ad30-25ac9386e1c4-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-cbac647a-735d-42c4-ad30-25ac9386e1c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-cbac647a-735d-42c4-ad30-25ac9386e1c4" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-cbac647a-735d-42c4-ad30-25ac9386e1c4" acquired by "delete_volume" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7784e-6999-4855-a575-0e43aac30008]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:14 devstack sudo[113616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4
Jun 29 05:07:14 devstack sudo[113616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:14 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 0.740s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410785bb-6553-4432-82f1-8739ea3a27ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d1ce8f-c586-4274-804f-576b74612f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:14 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Volume volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 (6fe2ff76-e98d-4954-b00b-8f25b8d0e559): created successfully
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d1ce8f-c586-4274-804f-576b74612f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Flow 'volume_create_manager' (02be3460-db65-402b-9fc7-893e20200003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-c4db17b3-0fe2-41db-a15e-af3239fda602 tempest-VolumeDependencyTests-170106998 None] Created volume successfully.
Jun 29 05:07:14 devstack sudo[113614]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Deleted volume successfully.
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0ef4a91-2b69-4573-8a29-e2d01481d56f tempest-VolumeAndVolumeTypeFromImageTest-433372537 None] Lock "cinder-770356ec-4207-4d25-afe9-ccf9740794b7-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:14 devstack sudo[113616]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4" returned: 0 in 0.894s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:14 devstack sudo[113623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4
Jun 29 05:07:14 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:15 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-cbac647a-735d-42c4-ad30-25ac9386e1c4" returned: 0 in 0.686s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-cbac647a-735d-42c4-ad30-25ac9386e1c4" released by "delete_volume" :: held 1.642s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['8d4a8a1c-52a7-41ae-8534-0bc0a526f7ef', 'c5b83288-737c-4400-b67f-ce222882afa6', 'bc2cfb75-3a8a-4e7c-9597-83e88f15e27a', '4895a365-b77a-4d02-b932-684d21cedff7'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Creating offline snapshot 7288ac55-10db-4f22-aed7-7130dbba0444 of volume 6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ba86d-66cb-40bc-a34a-268d04818ff5]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:15 devstack sudo[113628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:15 devstack sudo[113628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:15 devstack sudo[113626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:15 devstack sudo[113626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-b70afeef-c527-4254-9b50-4edb0299f8bd-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-b70afeef-c527-4254-9b50-4edb0299f8bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-b70afeef-c527-4254-9b50-4edb0299f8bd" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-b70afeef-c527-4254-9b50-4edb0299f8bd" acquired by "delete_volume" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770c682-1c7d-47c3-a87c-74764683ea9f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:16 devstack sudo[113665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd
Jun 29 05:07:16 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:16 devstack sudo[113626]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 1.087s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:16 devstack sudo[113628]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.060s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:16 devstack sudo[113673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 1G
Jun 29 05:07:16 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:16 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:16 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e2c5e03a-df7c-442f-bf7a-24e1fc89ebbd tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-cbac647a-735d-42c4-ad30-25ac9386e1c4-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:17 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd" returned: 0 in 0.978s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:17 devstack sudo[113678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd
Jun 29 05:07:17 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:17 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 1G" returned: 0 in 0.975s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:17 devstack sudo[113683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:17 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:18 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-b70afeef-c527-4254-9b50-4edb0299f8bd" returned: 0 in 0.729s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-b70afeef-c527-4254-9b50-4edb0299f8bd" released by "delete_volume" :: held 1.772s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['7d33cf91-fb43-4284-93c8-527eca8a7eb8', 'a5b6332d-a253-4af8-9fa6-22c5a58c4df0', '5745a8f1-91c4-4812-b2e1-4a6a4d3f0bbc', 'feb4ec99-753b-4f05-b579-8dd9c002cf8e'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:18 devstack sudo[113686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:18 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-631ebc7b-6f92-418c-b6c7-124cc229099c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-631ebc7b-6f92-418c-b6c7-124cc229099c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-631ebc7b-6f92-418c-b6c7-124cc229099c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-631ebc7b-6f92-418c-b6c7-124cc229099c" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ef62b-f83d-474d-9c31-8d789adda85e]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:18 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 0.810s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:18 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 is being set with open permissions: ugo+rw
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:18 devstack sudo[113693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:18 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:18 devstack sudo[113692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c
Jun 29 05:07:18 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:18 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.732s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:18 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b04286c4-23bd-41c6-9d29-b11a525e02e7 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-b70afeef-c527-4254-9b50-4edb0299f8bd-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:19 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 0.751s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:19 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c" returned: 0 in 0.868s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:19 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:19 devstack sudo[113701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info
Jun 29 05:07:19 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:19 devstack sudo[113703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c
Jun 29 05:07:19 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:20 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-631ebc7b-6f92-418c-b6c7-124cc229099c" returned: 0 in 0.777s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:20 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-631ebc7b-6f92-418c-b6c7-124cc229099c" released by "delete_volume" :: held 1.699s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info" returned: 0 in 0.834s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:20 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info is being set with open permissions: ugo+rw
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:20 devstack sudo[113707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info
Jun 29 05:07:20 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['defe8e5d-998d-4732-91d1-119f32995459', '1255c999-50fc-420c-8a7e-c7b55e675981', 'a3a13801-5be2-4602-8d0e-07a8302554cb', '7b5db012-2ea6-4905-b901-6889c1a5d715'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:20 devstack sudo[113709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:20 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc247b-637a-4f16-9bd1-0df081b2c7cd]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:20 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:21 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.info" returned: 0 in 0.765s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.361s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:21 devstack sudo[113712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88
Jun 29 05:07:21 devstack sudo[113712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-7286e5d2-17a4-4fd4-90d5-ad4157c6969c tempest-VolumeDependencyTests-170106998 None] Create snapshot completed successfully
Jun 29 05:07:21 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.818s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:21 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-58bc9b2b-46e3-4404-b74d-fa462253c8f8 tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-631ebc7b-6f92-418c-b6c7-124cc229099c-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:21 devstack sudo[113712]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" returned: 0 in 0.836s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:21 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:21 devstack sudo[113718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88
Jun 29 05:07:21 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:22 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" returned: 0 in 0.711s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88" released by "delete_volume" :: held 1.604s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['90fce7fc-faae-474e-b508-30a9878ae530', 'e424cff1-9531-46a2-a3e6-bdced54842df', 'fbfeb307-a942-4191-8b53-c1f057e5b5f8', '14e9918d-1fec-41dd-84d3-926e2fd2bcae'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Flow 'volume_create_manager' (5d96de49-7f58-4e64-bcd3-def51d26331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc7faf-beba-47bc-9bf0-db6272be90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc7faf-beba-47bc-9bf0-db6272be90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-600859911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc70ba4-eeae-463f-8e81-1d0969a87f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dce3d735e8648bfa914323844764fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7288ac55-10db-4f22-aed7-7130dbba0444,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:23Z,use_quota=True,user_id='e1c09af0dec046e4b874b090b7351717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d3bb6c-b0a3-4a81-b086-59a1679c1a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d3bb6c-b0a3-4a81-b086-59a1679c1a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322688d9-c8a7-4b5b-ac41-281447d9cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322688d9-c8a7-4b5b-ac41-281447d9cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4cc70ba4-eeae-463f-8e81-1d0969a87f93', 'volume_name': 'volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93', 'volume_size': 1, 'snapshot_id': '7288ac55-10db-4f22-aed7-7130dbba0444'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56755fcd-017c-452c-9b00-fa9a6ea176fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56755fcd-017c-452c-9b00-fa9a6ea176fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5a521-1ff2-43fd-bd94-9717228e8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:22 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Volume 4cc70ba4-eeae-463f-8e81-1d0969a87f93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93', 'volume_size': 1, 'snapshot_id': '7288ac55-10db-4f22-aed7-7130dbba0444'}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444-4cc70ba4-eeae-463f-8e81-1d0969a87f93" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444-4cc70ba4-eeae-463f-8e81-1d0969a87f93" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Creating volume 4cc70ba4-eeae-463f-8e81-1d0969a87f93 from snapshot 7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] snapshot: 7288ac55-10db-4f22-aed7-7130dbba0444, volume: 4cc70ba4-eeae-463f-8e81-1d0969a87f93,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:22 devstack sudo[113721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:22 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d69e4-b980-403a-bf68-0178e08bf95f]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:22 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:23 devstack sudo[113723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:23 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-9457419f-1ce2-4db0-b212-8ef4c19db309-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-9457419f-1ce2-4db0-b212-8ef4c19db309-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-9457419f-1ce2-4db0-b212-8ef4c19db309" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-9457419f-1ce2-4db0-b212-8ef4c19db309" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d12ef5-9025-4b84-8a9f-86dd751de369]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:23 devstack sudo[113725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309
Jun 29 05:07:23 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:23 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.859s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:23 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-3f2cdf4b-6e21-45cf-a0cd-9903b9d995fe tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-f0ef3d6b-8fbf-4ead-80a1-1327cca46a88-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:23 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 0.868s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[14578143-73d9-46ed-b1f1-625e6764e106]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:23 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:23 devstack sudo[113732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:23 devstack sudo[113732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:24 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309" returned: 0 in 1.094s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:24 devstack sudo[113737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309
Jun 29 05:07:24 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:24 devstack sudo[113732]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 1.090s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:24 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 05:07:24 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:24 devstack sudo[113742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93
Jun 29 05:07:24 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:25 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9457419f-1ce2-4db0-b212-8ef4c19db309" returned: 0 in 0.698s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-9457419f-1ce2-4db0-b212-8ef4c19db309" released by "delete_volume" :: held 1.850s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['f164b1c7-0956-4929-b581-db46e67b2ed0', '7b5d3d7b-f26a-4c21-948a-8fead17e2f5d', 'e24c1642-2861-4ef1-b5ef-9c502b4b3364', '568eddd3-f245-46fd-b3f1-2580e8359420'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:25 devstack sudo[113745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:25 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-614f9cae-c0d7-4586-93bb-82febca74566-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-614f9cae-c0d7-4586-93bb-82febca74566-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-614f9cae-c0d7-4586-93bb-82febca74566" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-614f9cae-c0d7-4586-93bb-82febca74566" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleting offline snapshot 614f9cae-c0d7-4586-93bb-82febca74566 of volume 1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] snapshot_file for this snap is: volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33cbcb-bf07-4ff8-99ed-e20e13c31c57]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:25 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:25 devstack sudo[113749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566
Jun 29 05:07:25 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:26 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566" returned: 0 in 1.351s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:07:26 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.717s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86301c9-5433-48f1-9b48-5ee9bc18c5cf]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:26 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:26 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=206,cinder:SELECT=143,cinder:INSERT=52,cinder:DELETE=22 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:07:27 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-1b31c8e0-3513-40ba-95db-c6107e39a21a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-9457419f-1ce2-4db0-b212-8ef4c19db309-delete_volume" released by "delete_volume" :: held 3.948s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:27 devstack sudo[113764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3
Jun 29 05:07:27 devstack sudo[113764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:28 devstack sudo[113764]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" returned: 0 in 1.483s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:28 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:28 devstack sudo[113770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566
Jun 29 05:07:28 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:29 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566" returned: 0 in 1.553s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:29 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:30 devstack sudo[113775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566
Jun 29 05:07:30 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:31 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93" returned: 0 in 6.325s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef0d3a-f7e3-4f13-9969-1228d4b9cec7]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:31 devstack sudo[113777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:31 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:31 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3.614f9cae-c0d7-4586-93bb-82febca74566" returned: 0 in 1.512s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-614f9cae-c0d7-4586-93bb-82febca74566" released by "_delete_snapshot" :: held 6.129s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" released by "delete_snapshot" :: held 6.163s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['44842460-f3eb-4f42-984e-864431e486c5', '7e6224ea-d1e4-469a-9ee9-a22381b6c34a', '3be50a7f-4922-407c-bd6d-2bcc9c70139d', 'ea78b12c-b8de-4cd7-a156-682fac9fd5cd'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:31 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Delete snapshot completed successfully.
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-959c1d82-88e5-48a1-bcd5-a594d23bd23b tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-614f9cae-c0d7-4586-93bb-82febca74566-delete_snapshot" released by "delete_snapshot" :: held 6.357s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-1a8c2f64-d92f-4084-adfe-fcdb99473ac3-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:31 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-1a8c2f64-d92f-4084-adfe-fcdb99473ac3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" acquired by "delete_volume" :: waited 0.051s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb8234-6527-4dfe-946c-68918b4e9b83]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:32 devstack sudo[113782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3
Jun 29 05:07:32 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:32 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 1.232s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:07:32 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Converted 1024.00 MB image at 161.85 MB/s
Jun 29 05:07:32 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 is being set with open permissions: ugo+rw
Jun 29 05:07:32 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:32 devstack sudo[113785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93
Jun 29 05:07:32 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:33 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" returned: 0 in 0.940s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:33 devstack sudo[113793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3
Jun 29 05:07:33 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:33 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93" returned: 0 in 0.718s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" released by "_copy_volume_from_snapshot" :: held 10.376s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444-4cc70ba4-eeae-463f-8e81-1d0969a87f93" released by "_create_volume_from_snapshot" :: held 10.412s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.437s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5a521-1ff2-43fd-bd94-9717228e8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93', 'volume_size': 1, 'snapshot_id': '7288ac55-10db-4f22-aed7-7130dbba0444'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528a60d7-ac6d-4cbc-b267-5fa1a053b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:33 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Volume volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 (4cc70ba4-eeae-463f-8e81-1d0969a87f93): created successfully
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528a60d7-ac6d-4cbc-b267-5fa1a053b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Flow 'volume_create_manager' (5d96de49-7f58-4e64-bcd3-def51d26331e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:33 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e1501337-7c21-498c-962c-4b1b4ae5c29b tempest-VolumeDependencyTests-170106998 None] Created volume successfully.
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-7288ac55-10db-4f22-aed7-7130dbba0444-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-7288ac55-10db-4f22-aed7-7130dbba0444-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:33 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" returned: 0 in 0.723s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" acquired by "delete_snapshot" :: waited 0.062s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-quobyte-1a8c2f64-d92f-4084-adfe-fcdb99473ac3" released by "delete_volume" :: held 1.774s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Deleting offline snapshot 7288ac55-10db-4f22-aed7-7130dbba0444 of volume 6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] snapshot_file for this snap is: volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e2544-0fa0-4325-9a2b-bcd5b1c34176]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:33 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Created reservations ['bcee812d-b129-4ee7-8c6b-79300b11af51', '48c02cde-23f9-4eac-8e42-84b9e13356e7', 'd56701fc-dc36-4399-98b9-0477335f3242', '2f1951d5-19b6-4d8f-ba83-11a2f91f4894'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:34 devstack sudo[113796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:34 devstack sudo[113796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:34 devstack sudo[113798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:34 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:34 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.745s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:34 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Deleted volume successfully.
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-586a145c-6dd5-4e45-b871-3c99d2db617a tempest-CreateVolumesFromSnapshotTest-420006839 None] Lock "cinder-1a8c2f64-d92f-4084-adfe-fcdb99473ac3-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:34 devstack sudo[113796]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 1.023s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[189802a9-489d-4dfe-973d-21fe374d4b3a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:34 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:35 devstack sudo[113804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:35 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:35 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 0.914s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:35 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:35 devstack sudo[113810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:35 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:36 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:36 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:36 devstack sudo[113817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444
Jun 29 05:07:36 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:37 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:37 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559.7288ac55-10db-4f22-aed7-7130dbba0444" returned: 0 in 0.730s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-7288ac55-10db-4f22-aed7-7130dbba0444" released by "_delete_snapshot" :: held 3.591s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" released by "delete_snapshot" :: held 3.626s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:37 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Created reservations ['1c63a941-b03a-4468-a245-0fc371cf8b43', 'e28a1924-3b97-45a6-9a16-64345209aaf2', '6900c78e-31a2-4a1c-90c5-aba7ee4096de', 'd7933749-3eab-437a-998d-deac8e2aa309'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:37 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Delete snapshot completed successfully.
Jun 29 05:07:37 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-2103df3c-c622-48b9-a0eb-577f31314d22 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-7288ac55-10db-4f22-aed7-7130dbba0444-delete_snapshot" released by "delete_snapshot" :: held 3.829s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-6fe2ff76-e98d-4954-b00b-8f25b8d0e559-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "cinder-6fe2ff76-e98d-4954-b00b-8f25b8d0e559-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" acquired by "delete_volume" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd32da49-ea2d-487a-97f5-75539b151242]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:38 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:38 devstack sudo[113820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:38 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:39 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 0.955s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:39 devstack sudo[113825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559
Jun 29 05:07:39 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:39 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:39 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" returned: 0 in 0.709s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-6fe2ff76-e98d-4954-b00b-8f25b8d0e559" released by "delete_volume" :: held 1.757s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Created reservations ['c5eb06e0-9b21-4f96-a22d-67385553daf0', 'aa43e7d8-2a66-4c11-b909-649fcbec025f', '94208542-3c85-4604-93e1-f6c02364da18', 'aaeff182-27eb-47ec-b2ae-3ca91c0b3489'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:40 devstack sudo[113828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:40 devstack sudo[113828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-4cc70ba4-eeae-463f-8e81-1d0969a87f93-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-4cc70ba4-eeae-463f-8e81-1d0969a87f93-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" acquired by "delete_volume" :: waited 0.025s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57f24d-9577-49dc-884e-267c678e8bbc]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:40 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:40 devstack sudo[113830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93
Jun 29 05:07:40 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Flow 'volume_create_manager' (ab5b116c-9cba-4f69-88a5-0261e272a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f4c28d-c363-4e04-8d66-fef091314ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f4c28d-c363-4e04-8d66-fef091314ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1420c5-67ce-4665-a36f-e38f735ea86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061e60ae3095486994e81eaf724656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:41Z,use_quota=True,user_id='4bca794e0c124f0eb5c642cfbe0eb624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174778fa-0ef7-487d-aff8-870eaa39a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174778fa-0ef7-487d-aff8-870eaa39a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65bedf4-c170-47d1-908f-ffff4d9594ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.image.glance [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Creating Keystone auth plugin from conf {{(pid=93723) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 29 05:07:41 devstack sudo[113828]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 1.046s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:41 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Deleted volume successfully.
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ec3b8a54-d4ee-4fbf-a9ad-f183f18c30ae tempest-VolumeDependencyTests-170106998 None] Lock "cinder-6fe2ff76-e98d-4954-b00b-8f25b8d0e559-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65bedf4-c170-47d1-908f-ffff4d9594ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e1420c5-67ce-4665-a36f-e38f735ea86f', 'volume_name': 'volume-9e1420c5-67ce-4665-a36f-e38f735ea86f', 'volume_size': 1, 'image_id': '704d5166-60af-4f78-8114-240c380807e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e450f99a3412b93e49305efb83b6862a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061e60ae3095486994e81eaf724656b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2caeaa8a44a08b8ba35c5fbcaf2a03f653be5145fe47a1faa6cf5892c4bc7f9dc9010393f9932b82772392c697e53369765775a69e66751e08d735e79d1a7cf', 'id': '704d5166-60af-4f78-8114-240c380807e3', 'created_at': datetime.datetime(2026, 6, 29, 3, 7, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704d5166-60af-4f78-8114-240c380807e3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a720>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1635f31a-be05-4baa-8195-b92614fbd95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1635f31a-be05-4baa-8195-b92614fbd95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a08930-65c6-4db7-a282-544e1292f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:41 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Volume 9e1420c5-67ce-4665-a36f-e38f735ea86f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e1420c5-67ce-4665-a36f-e38f735ea86f', 'volume_size': 1, 'image_id': '704d5166-60af-4f78-8114-240c380807e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e450f99a3412b93e49305efb83b6862a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061e60ae3095486994e81eaf724656b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2caeaa8a44a08b8ba35c5fbcaf2a03f653be5145fe47a1faa6cf5892c4bc7f9dc9010393f9932b82772392c697e53369765775a69e66751e08d735e79d1a7cf', 'id': '704d5166-60af-4f78-8114-240c380807e3', 'created_at': datetime.datetime(2026, 6, 29, 3, 7, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704d5166-60af-4f78-8114-240c380807e3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a720>}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Trying to clone 9e1420c5-67ce-4665-a36f-e38f735ea86f from image 704d5166-60af-4f78-8114-240c380807e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}]). {{(pid=93723) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 29 05:07:41 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Image download 0.00 MB at 0.00 MB/s
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4552434-2d5a-42a7-9355-0210834069e8]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:41 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93" returned: 0 in 1.045s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:41 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:41 devstack sudo[113838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93
Jun 29 05:07:41 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:41 devstack sudo[113837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:41 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:42 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-4cc70ba4-eeae-463f-8e81-1d0969a87f93" returned: 0 in 0.688s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-quobyte-4cc70ba4-eeae-463f-8e81-1d0969a87f93" released by "delete_volume" :: held 1.805s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:42 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 0 in 0.775s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Created reservations ['fcd3304c-3d66-4534-a1b7-67e2d2d02e7a', '5da8cd9e-6bfd-4660-8e92-790cde3edf87', '57e78a15-8b3b-4737-bcf1-a33e31242dd9', '16d1d46c-32bd-4940-b9aa-a0aa09b61a9a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:42 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:42 devstack sudo[113844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:42 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:42 devstack sudo[113845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:42 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:43 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 1 in 0.842s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Temporary image 704d5166-60af-4f78-8114-240c380807e3 is fetched for user 4bca794e0c124f0eb5c642cfbe0eb624. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 29 05:07:43 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.789s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:43 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Deleted volume successfully.
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-8acf7104-9fe3-407b-8f99-9554a1ad2359 tempest-VolumeDependencyTests-170106998 None] Lock "cinder-4cc70ba4-eeae-463f-8e81-1d0969a87f93-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077f92b-4a06-4e30-9fac-45f97aac9411]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:43 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:43 devstack sudo[113852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:43 devstack sudo[113852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:44 devstack sudo[113852]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:44 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:44 devstack sudo[113858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:44 devstack sudo[113858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:45 devstack sudo[113858]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 1 in 0.932s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1420c5-67ce-4665-a36f-e38f735ea86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061e60ae3095486994e81eaf724656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:41Z,use_quota=True,user_id='4bca794e0c124f0eb5c642cfbe0eb624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Creating volume 9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:45 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:45 devstack sudo[113864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1073741824
Jun 29 05:07:45 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Flow 'volume_create_manager' (36e36e86-de65-4be2-8c4a-28858b070638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665e6e9e-987d-4319-9d4d-c8e04ac9e7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665e6e9e-987d-4319-9d4d-c8e04ac9e7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1931269521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15751ff-0667-448b-ab09-2fd4df9dfa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8afe5c599749bebcf130ae84debeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:46Z,use_quota=True,user_id='ba289db6c1bd48fdb64173076209fd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded703c6-1e82-48e0-9d59-77fd5865dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded703c6-1e82-48e0-9d59-77fd5865dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995fb3e-2733-4f6e-8be8-ff45ccb205f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995fb3e-2733-4f6e-8be8-ff45ccb205f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15751ff-0667-448b-ab09-2fd4df9dfa2c', 'volume_name': 'volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c81550f-cd31-44f4-95ed-09ef7c882318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c81550f-cd31-44f4-95ed-09ef7c882318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f195b410-f62c-4c1a-8ebf-4a330e8776b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:45 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Volume f15751ff-0667-448b-ab09-2fd4df9dfa2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c', 'volume_size': 1}
Jun 29 05:07:45 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:46 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1073741824" returned: 0 in 0.933s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:46 devstack sudo[113871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:46 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:46 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 0 in 0.721s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1931269521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15751ff-0667-448b-ab09-2fd4df9dfa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8afe5c599749bebcf130ae84debeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:46Z,use_quota=True,user_id='ba289db6c1bd48fdb64173076209fd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Creating volume f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:46 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:46 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:47 devstack sudo[113874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c 1073741824
Jun 29 05:07:47 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Attempting download of 704d5166-60af-4f78-8114-240c380807e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}])) to volume 9e1420c5-67ce-4665-a36f-e38f735ea86f. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f5191-5841-4060-865b-d7c6ae003503]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Flow 'volume_create_manager' (c149e6b9-5d8a-4b2e-99d7-d67d2ea71da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c94c35-d7d8-4cdd-b488-8e075188b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c94c35-d7d8-4cdd-b488-8e075188b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece7b90-5e87-46b7-b6d3-f375f9b47ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c8e0cc5bad487db39bb416b37110c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:47Z,use_quota=True,user_id='44a0522cd36547f38353a4baa7d5f957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cfe750-1f28-4f88-8c98-2efe6b674e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cfe750-1f28-4f88-8c98-2efe6b674e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1fd870-ce8a-430a-b7f1-804da3055b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1fd870-ce8a-430a-b7f1-804da3055b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ece7b90-5e87-46b7-b6d3-f375f9b47ff8', 'volume_name': 'volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14683163-de7d-4456-9542-17571cc45080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14683163-de7d-4456-9542-17571cc45080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838811ec-1108-4bab-971a-6a37db844deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:47 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Volume 9ece7b90-5e87-46b7-b6d3-f375f9b47ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8', 'volume_size': 1}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:47 devstack sudo[113876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g
Jun 29 05:07:47 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:47 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:47 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c 1073741824" returned: 0 in 0.847s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g" returned: 0 in 0.747s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:47 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:47 devstack sudo[113884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:07:47 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:47 devstack sudo[113883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g
Jun 29 05:07:47 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:48 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.650s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece7b90-5e87-46b7-b6d3-f375f9b47ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c8e0cc5bad487db39bb416b37110c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:47Z,use_quota=True,user_id='44a0522cd36547f38353a4baa7d5f957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Creating volume 9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:48 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:48 devstack sudo[113896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 1073741824
Jun 29 05:07:48 devstack sudo[113896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f195b410-f62c-4c1a-8ebf-4a330e8776b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcad413-7e4d-4740-94a8-dcfcecffc5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:48 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g" returned: 1 in 0.751s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_704d5166-60af-4f78-8114-240c380807e3_y03co57g' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:48 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Volume volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c (f15751ff-0667-448b-ab09-2fd4df9dfa2c): created successfully
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcad413-7e4d-4740-94a8-dcfcecffc5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Flow 'volume_create_manager' (36e36e86-de65-4be2-8c4a-28858b070638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef68427-0c81-43b8-9189-75f35afa38e4]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:48 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-f78f91b3-b07e-43d8-89fb-920ebb1068c0 tempest-SnapshotDependencyTests-1563264765 None] Created volume successfully.
Jun 29 05:07:48 devstack sudo[113898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:48 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:48 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:49 devstack sudo[113896]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:49 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 1073741824" returned: 0 in 0.851s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:49 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:49 devstack sudo[113906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8
Jun 29 05:07:49 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:49 devstack sudo[113905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD
Jun 29 05:07:49 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:50 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" returned: 0 in 0.674s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.128s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:50 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD" returned: 1 in 0.726s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] 704d5166-60af-4f78-8114-240c380807e3 was raw, converting to raw {{(pid=93723) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:50 devstack sudo[113913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:50 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838811ec-1108-4bab-971a-6a37db844deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f33fd4-136e-4342-a73b-106bf536eff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Creating offline snapshot 8fca40ab-9aec-4aa2-9f0d-a594dc8a60db of volume f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:07:50 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Volume volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 (9ece7b90-5e87-46b7-b6d3-f375f9b47ff8): created successfully
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f33fd4-136e-4342-a73b-106bf536eff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Flow 'volume_create_manager' (c149e6b9-5d8a-4b2e-99d7-d67d2ea71da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e7337-bc5b-4b80-8d37-678080201cc1]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:50 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-217b7bc2-3ffe-4eb9-9a04-56b0b40dc7f8 tempest-CinderUnicodeTest-1005332463 None] Created volume successfully.
Jun 29 05:07:50 devstack sudo[113915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:07:50 devstack sudo[113915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:50 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 0 in 0.797s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_704d5166-60af-4f78-8114-240c380807e3_5l87xgd9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:07:50 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Converted 0.00 MB image at 0.00 MB/s
Jun 29 05:07:50 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:50 devstack sudo[113923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1G
Jun 29 05:07:50 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:51 devstack sudo[113915]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.833s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:51 devstack sudo[113925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db 1G
Jun 29 05:07:51 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:51 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f 1G" returned: 0 in 0.767s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd186abb-02cb-4b28-9071-bc5be7ed4f6e]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:UPDATE=207,cinder:SELECT=142,cinder:INSERT=57,cinder:DELETE=17 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:51 devstack sudo[113933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:51 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Flow 'volume_create_manager' (e517435e-ab90-469f-988b-7269c4a34df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba4a302-8aed-46a0-8311-b57326ed2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba4a302-8aed-46a0-8311-b57326ed2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-187621090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f6b484-c71a-4217-85ca-4ae4ab4b6180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c8e0cc5bad487db39bb416b37110c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:52Z,use_quota=True,user_id='44a0522cd36547f38353a4baa7d5f957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62974a-e12c-45ac-9ec6-2fcff6979d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62974a-e12c-45ac-9ec6-2fcff6979d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3017cdce-9803-4e84-8958-974b00827313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3017cdce-9803-4e84-8958-974b00827313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f6b484-c71a-4217-85ca-4ae4ab4b6180', 'volume_name': 'volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805661c8-771d-483b-b038-af01d38713f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805661c8-771d-483b-b038-af01d38713f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609bb49-0bb8-4494-a511-e7baf063a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:51 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Volume 15f6b484-c71a-4217-85ca-4ae4ab4b6180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180', 'volume_size': 1}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:51 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db 1G" returned: 0 in 0.939s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:51 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:52 devstack sudo[113936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:07:52 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:52 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 0 in 0.785s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:52 devstack sudo[113942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:52 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:52 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.681s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:52 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db is being set with open permissions: ugo+rw
Jun 29 05:07:52 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:52 devstack sudo[113945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:07:52 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:53 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 1 in 0.742s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Downloaded image 704d5166-60af-4f78-8114-240c380807e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}])) to volume 9e1420c5-67ce-4665-a36f-e38f735ea86f successfully. {{(pid=93723) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Temporary image 704d5166-60af-4f78-8114-240c380807e3 for user 4bca794e0c124f0eb5c642cfbe0eb624 is deleted. {{(pid=93723) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.volume_utils [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Marking volume 9e1420c5-67ce-4665-a36f-e38f735ea86f as bootable. {{(pid=93723) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Copying metadata from image 704d5166-60af-4f78-8114-240c380807e3 to 9e1420c5-67ce-4665-a36f-e38f735ea86f. {{(pid=93723) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Creating volume glance metadata for volume 9e1420c5-67ce-4665-a36f-e38f735ea86f backed by image 704d5166-60af-4f78-8114-240c380807e3 with: {'image_id': '704d5166-60af-4f78-8114-240c380807e3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e450f99a3412b93e49305efb83b6862a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93723) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 29 05:07:53 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.632s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:53 devstack sudo[113951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info
Jun 29 05:07:53 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a08930-65c6-4db7-a282-544e1292f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1420c5-67ce-4665-a36f-e38f735ea86f', 'volume_size': 1, 'image_id': '704d5166-60af-4f78-8114-240c380807e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/704d5166-60af-4f78-8114-240c380807e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e450f99a3412b93e49305efb83b6862a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061e60ae3095486994e81eaf724656b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2caeaa8a44a08b8ba35c5fbcaf2a03f653be5145fe47a1faa6cf5892c4bc7f9dc9010393f9932b82772392c697e53369765775a69e66751e08d735e79d1a7cf', 'id': '704d5166-60af-4f78-8114-240c380807e3', 'created_at': datetime.datetime(2026, 6, 29, 3, 7, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 3, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/704d5166-60af-4f78-8114-240c380807e3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7bd872d2a720>}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d7a963-cd49-47e5-9b28-1f10dd06c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:53 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Volume volume-9e1420c5-67ce-4665-a36f-e38f735ea86f (9e1420c5-67ce-4665-a36f-e38f735ea86f): created successfully
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d7a963-cd49-47e5-9b28-1f10dd06c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Flow 'volume_create_manager' (ab5b116c-9cba-4f69-88a5-0261e272a003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:53 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-4ed1628d-e4ce-465d-9303-149beb32f067 tempest-VolumeImageDependencyTests-1956257324 None] Created volume successfully.
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Acquiring lock "cinder-9e1420c5-67ce-4665-a36f-e38f735ea86f-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "cinder-9e1420c5-67ce-4665-a36f-e38f735ea86f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Acquiring lock "cinder-quobyte-9e1420c5-67ce-4665-a36f-e38f735ea86f" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "cinder-quobyte-9e1420c5-67ce-4665-a36f-e38f735ea86f" acquired by "delete_volume" :: waited 0.014s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2426f-27a3-46cb-8361-ced49f3ee358]: (4, 'raw') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:53 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:54 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info" returned: 0 in 0.678s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:54 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info is being set with open permissions: ugo+rw
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:54 devstack sudo[113954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:54 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:54 devstack sudo[113955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info
Jun 29 05:07:54 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:54 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.info" returned: 0 in 0.658s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:54 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.582s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7bd873e048c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-187621090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f6b484-c71a-4217-85ca-4ae4ab4b6180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c8e0cc5bad487db39bb416b37110c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:52Z,use_quota=True,user_id='44a0522cd36547f38353a4baa7d5f957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)}" {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Creating volume 15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:54 devstack cinder-volume[93723]: INFO cinder.volume.drivers.remotefs [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] casted to osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 1073741824 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 0 in 0.795s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:54 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:54 devstack sudo[113961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 1073741824
Jun 29 05:07:54 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:54 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-66929807-888a-4162-a08b-0680726ceefb tempest-SnapshotDependencyTests-1563264765 None] Create snapshot completed successfully
Jun 29 05:07:54 devstack sudo[113962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:54 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:55 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:55 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 1073741824" returned: 0 in 0.838s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 1 in 0.825s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f' failed. Not Retrying. {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:55 devstack sudo[113972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f
Jun 29 05:07:55 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:55 devstack sudo[113974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180
Jun 29 05:07:55 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93723) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Flow 'volume_create_manager' (b6114056-6040-4de9-8604-1fdd9d35c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3c49f0-46e8-4b87-a571-ac0240b677bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3c49f0-46e8-4b87-a571-ac0240b677bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-29T03:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c2b746-051d-4410-99c9-282d111965a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8afe5c599749bebcf130ae84debeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T03:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fca40ab-9aec-4aa2-9f0d-a594dc8a60db,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T03:07:56Z,use_quota=True,user_id='ba289db6c1bd48fdb64173076209fd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2c1332-bb74-4a65-be32-5d2834e79051),volume_type_id=6c2c1332-bb74-4a65-be32-5d2834e79051)' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567939d5-f9c5-426f-bf0e-d0879a4dff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567939d5-f9c5-426f-bf0e-d0879a4dff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44264a81-be3e-4b9b-a80b-a9385461f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44264a81-be3e-4b9b-a80b-a9385461f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0c2b746-051d-4410-99c9-282d111965a5', 'volume_name': 'volume-a0c2b746-051d-4410-99c9-282d111965a5', 'volume_size': 1, 'snapshot_id': '8fca40ab-9aec-4aa2-9f0d-a594dc8a60db'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4e82d-cc13-48fc-a2c0-c1ad7abf50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:55 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4e82d-cc13-48fc-a2c0-c1ad7abf50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8560740-0ddd-48cb-b211-61dae34c3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Volume a0c2b746-051d-4410-99c9-282d111965a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0c2b746-051d-4410-99c9-282d111965a5', 'volume_size': 1, 'snapshot_id': '8fca40ab-9aec-4aa2-9f0d-a594dc8a60db'}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:56 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9e1420c5-67ce-4665-a36f-e38f735ea86f" returned: 0 in 0.685s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "cinder-quobyte-9e1420c5-67ce-4665-a36f-e38f735ea86f" released by "delete_volume" :: held 2.369s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Created reservations ['b376da4d-fd28-4cd9-8409-e5b3d45ff09a', '046e8427-eaf4-41a2-9c70-3e4ca5322b85', '518a3d0b-30f2-4e1d-a1e2-fcae9e2f8ef3', 'cad79f18-f6be-4908-b86a-dcc1f83781f0'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:07:56 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180" returned: 0 in 0.692s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'} {{(pid=93723) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.278s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-a0c2b746-051d-4410-99c9-282d111965a5" by "_create_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609bb49-0bb8-4494-a511-e7baf063a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180', 'volume_size': 1}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dbd540-eee7-4248-b03e-309ef97ca924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-a0c2b746-051d-4410-99c9-282d111965a5" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Creating volume a0c2b746-051d-4410-99c9-282d111965a5 from snapshot 8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Selected osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce as target Quobyte volume. {{(pid=93723) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" by "_copy_volume_from_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:07:56 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Volume volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 (15f6b484-c71a-4217-85ca-4ae4ab4b6180): created successfully
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dbd540-eee7-4248-b03e-309ef97ca924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Flow 'volume_create_manager' (e517435e-ab90-469f-988b-7269c4a34df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] snapshot: 8fca40ab-9aec-4aa2-9f0d-a594dc8a60db, volume: a0c2b746-051d-4410-99c9-282d111965a5,  {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 29 05:07:56 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-1f39d110-755c-4610-ae34-5d802dc7879b tempest-CinderUnicodeTest-1005332463 None] Created volume successfully.
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344c740-6e79-49c1-8837-6340d6a51b4a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:07:56 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:56 devstack sudo[113980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:07:56 devstack sudo[113980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:56 devstack sudo[113979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:07:56 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:57 devstack sudo[113980]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.654s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:07:57 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Deleted volume successfully.
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-e0f7d25a-389a-4d9c-a026-401399859bba tempest-VolumeImageDependencyTests-1956257324 None] Lock "cinder-9e1420c5-67ce-4665-a36f-e38f735ea86f-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:07:57 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.837s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Creating direct copy from snapshot {{(pid=93723) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5f7e9-1233-4401-8723-6ae8de0b7508]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:57 devstack sudo[113988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:07:57 devstack sudo[113988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:07:57 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:07:58 devstack sudo[113988]: pam_unix(sudo:session): session closed for user root
Jun 29 05:07:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.826s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:07:58 devstack cinder-volume[93723]: DEBUG cinder.utils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Path /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 not found in is_blk_device check {{(pid=93723) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 29 05:07:58 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:07:58 devstack sudo[113993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5
Jun 29 05:07:58 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:02 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5" returned: 0 in 4.622s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:02 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2decfc-b24c-4c55-b529-1dccfe506b74]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:02 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:02 devstack sudo[114006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:08:02 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:03 devstack sudo[114010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:08:03 devstack sudo[114010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:03 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.899s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG cinder.image.image_utils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Image conversion details: src /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 {{(pid=93723) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 29 05:08:03 devstack cinder-volume[93723]: INFO cinder.image.image_utils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Converted 1024.00 MB image at 221.48 MB/s
Jun 29 05:08:03 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 is being set with open permissions: ugo+rw
Jun 29 05:08:03 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:03 devstack sudo[114013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5
Jun 29 05:08:03 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:04 devstack sudo[114010]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.630s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_service.periodic_task [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] Running periodic task VolumeManager._thread_info {{(pid=93723) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread count: 29 {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-0ee9c58d-aedd-48da-b211-f94057b929fd None None] thread info: [<_MainThread(MainThread, started 136169693642880)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136169584868416)>, <Thread(Thread-3 (stat_writer), started daemon 136169586359552)>, <Thread(Rabbit-heartbeat, started daemon 136169582037888)>, <Thread(Thread-5 (_runner), started daemon 136169582157568)>, <Thread(Thread-7 (_runner), started daemon 136169582167104)>, <Thread(fd_logger, started daemon 136169579874496)>, <Thread(privsep_reader, started daemon 136169578320064)>, <Thread(tpool_thread_0, started daemon 136169568454336)>, <Thread(tpool_thread_1, started daemon 136169560061632)>, <Thread(tpool_thread_2, started daemon 136169551652544)>, <Thread(tpool_thread_3, started daemon 136169543243456)>, <Thread(tpool_thread_4, started daemon 136169534834368)>, <Thread(tpool_thread_5, started daemon 136169526425280)>, <Thread(tpool_thread_6, started daemon 136169518016192)>, <Thread(tpool_thread_7, started daemon 136169509607104)>, <Thread(tpool_thread_8, started daemon 136169501198016)>, <Thread(tpool_thread_9, started daemon 136169492788928)>, <Thread(tpool_thread_10, started daemon 136169484379840)>, <Thread(tpool_thread_11, started daemon 136169475970752)>, <Thread(tpool_thread_12, started daemon 136169467561664)>, <Thread(tpool_thread_13, started daemon 136169459152576)>, <Thread(tpool_thread_14, started daemon 136169450743488)>, <Thread(tpool_thread_15, started daemon 136169442334400)>, <Thread(tpool_thread_16, started daemon 136169433925312)>, <Thread(tpool_thread_17, started daemon 136169425516224)>, <Thread(tpool_thread_18, started daemon 136169417107136)>, <Thread(tpool_thread_19, started daemon 136169408698048)>, <Thread(Rabbit-heartbeat, started daemon 136169570101952)>] {{(pid=93723) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 29 05:08:04 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5" returned: 0 in 0.655s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" released by "_copy_volume_from_snapshot" :: held 7.957s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-a0c2b746-051d-4410-99c9-282d111965a5" released by "_create_volume_from_snapshot" :: held 8.007s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.044s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.874s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Creating offline snapshot b7b7549d-3864-414f-8aae-5d590d02a32f of volume 15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e3081e-ff9e-45ad-8dba-57a70d529157]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8560740-0ddd-48cb-b211-61dae34c3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c2b746-051d-4410-99c9-282d111965a5', 'volume_size': 1, 'snapshot_id': '8fca40ab-9aec-4aa2-9f0d-a594dc8a60db'}' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb1ebf4-7136-4802-9445-33927ce0feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 29 05:08:04 devstack cinder-volume[93723]: INFO cinder.volume.flows.manager.create_volume [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Volume volume-a0c2b746-051d-4410-99c9-282d111965a5 (a0c2b746-051d-4410-99c9-282d111965a5): created successfully
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb1ebf4-7136-4802-9445-33927ce0feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93723) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 29 05:08:04 devstack cinder-volume[93723]: DEBUG cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Flow 'volume_create_manager' (b6114056-6040-4de9-8604-1fdd9d35c010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93723) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 29 05:08:04 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-6b93d93e-8cf0-4d7f-aac5-219ce949395c tempest-SnapshotDependencyTests-1563264765 None] Created volume successfully.
Jun 29 05:08:04 devstack sudo[114017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180
Jun 29 05:08:04 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:05 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180" returned: 0 in 0.740s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f 1G {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:05 devstack sudo[114022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f 1G
Jun 29 05:08:05 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Deleting offline snapshot 8fca40ab-9aec-4aa2-9f0d-a594dc8a60db of volume f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] snapshot_file for this snap is: volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505a770-f614-4a55-8ea3-746ded5d327b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:05 devstack sudo[114028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:08:05 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:05 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f 1G" returned: 0 in 0.801s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:05 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:05 devstack sudo[114031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f
Jun 29 05:08:05 devstack sudo[114031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:06 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a94e1-d669-400a-8ac9-45757d9e33a9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:06 devstack sudo[114039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:08:06 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:06 devstack sudo[114031]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 -F qcow2 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f" returned: 0 in 0.699s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:06 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f is being set with open permissions: ugo+rw
Jun 29 05:08:06 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:06 devstack sudo[114041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f
Jun 29 05:08:06 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:07 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.773s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:07 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f" returned: 0 in 0.647s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:07 devstack sudo[114048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:08:07 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:07 devstack sudo[114050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info
Jun 29 05:08:07 devstack sudo[114050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:07 devstack sudo[114050]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info" returned: 0 in 0.655s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:07 devstack cinder-volume[93723]: WARNING cinder.volume.drivers.remotefs [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info is being set with open permissions: ugo+rw
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:07 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.722s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:07 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:08 devstack sudo[114056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info
Jun 29 05:08:08 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:08 devstack sudo[114057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db
Jun 29 05:08:08 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:08 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.info" returned: 0 in 0.652s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.294s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:08 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c.8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" returned: 0 in 0.668s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-8dbcf314-328e-4f7b-ae27-78b074c1853a tempest-CinderUnicodeTest-1005332463 None] Create snapshot completed successfully
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db" released by "_delete_snapshot" :: held 3.026s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" released by "delete_snapshot" :: held 3.049s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Created reservations ['d1b31606-1ae3-4d52-ad9f-8dd0e236bfaf', '6ea93552-6627-428e-ae24-522466cad57e', '90fb1be9-8150-4a06-895e-b5edc305c52b', 'f7ba6d5e-cee5-4989-b7c4-214b0a3502b3'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:08 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Delete snapshot completed successfully.
Jun 29 05:08:08 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-385d601d-6810-45e3-9e64-4550307bea38 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-8fca40ab-9aec-4aa2-9f0d-a594dc8a60db-delete_snapshot" released by "delete_snapshot" :: held 3.180s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-b7b7549d-3864-414f-8aae-5d590d02a32f-delete_snapshot" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-b7b7549d-3864-414f-8aae-5d590d02a32f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" by "delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-quobyte-b7b7549d-3864-414f-8aae-5d590d02a32f" by "_delete_snapshot" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-b7b7549d-3864-414f-8aae-5d590d02a32f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Deleting offline snapshot b7b7549d-3864-414f-8aae-5d590d02a32f of volume 15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] snapshot_file for this snap is: volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f93022-fd56-4e2b-aae3-1151b857935a]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:09 devstack sudo[114062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f
Jun 29 05:08:09 devstack sudo[114062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-f15751ff-0667-448b-ab09-2fd4df9dfa2c-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-f15751ff-0667-448b-ab09-2fd4df9dfa2c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:09 devstack sudo[114062]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f" returned: 0 in 0.783s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.remotefs [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93723) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff5a9b-4faf-4ee7-ad38-6a2d14271393]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:09 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" acquired by "delete_volume" :: waited 0.017s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8b838-c656-4f55-a711-8882f90dcf7b]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:10 devstack sudo[114068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180
Jun 29 05:08:10 devstack sudo[114068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:10 devstack sudo[114069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:08:10 devstack sudo[114069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:10 devstack sudo[114068]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180" returned: 0 in 0.790s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:10 devstack sudo[114078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f
Jun 29 05:08:10 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:10 devstack sudo[114069]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.759s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:10 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:10 devstack sudo[114080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c
Jun 29 05:08:10 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:11 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-f15751ff-0667-448b-ab09-2fd4df9dfa2c" returned: 0 in 0.630s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-f15751ff-0667-448b-ab09-2fd4df9dfa2c" released by "delete_volume" :: held 1.450s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Created reservations ['f006a9f0-05ba-4556-a14f-1ce61c1e43c2', '691159ee-c3fe-4081-9e97-8889a91bae61', '4ec7072d-55eb-4ed0-b141-eb68031d3de0', 'f3ee0a3b-134a-4cb3-a4ef-5cd309622d5f'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:11 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f" returned: 0 in 0.756s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:11 devstack sudo[114086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f
Jun 29 05:08:11 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:11 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:11 devstack sudo[114088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:08:11 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-a0c2b746-051d-4410-99c9-282d111965a5-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-a0c2b746-051d-4410-99c9-282d111965a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:12 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180.b7b7549d-3864-414f-8aae-5d590d02a32f" returned: 0 in 0.669s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-b7b7549d-3864-414f-8aae-5d590d02a32f" released by "_delete_snapshot" :: held 3.141s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" released by "delete_snapshot" :: held 3.168s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" acquired by "delete_volume" :: waited 0.020s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[92adf201-aa5f-45f9-9d4d-504348ecabf9]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:12 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.717s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:08:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Deleted volume successfully.
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-ebea556f-884c-41a0-bff5-ae08cbda8200 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-f15751ff-0667-448b-ab09-2fd4df9dfa2c-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Created reservations ['cd2d374d-b438-4e3b-aadc-955cc59dfabf', '3760b5f6-bc2d-48cc-b55b-792f18c4f7af', '7883e4da-7d0d-4af5-8dff-43668fcc1964', '205586c2-3db1-4140-9f91-8d87b9340637'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:12 devstack sudo[114092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5
Jun 29 05:08:12 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:12 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Delete snapshot completed successfully.
Jun 29 05:08:12 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-b3c107e7-be28-4cd8-96cd-6bb1b12db713 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-b7b7549d-3864-414f-8aae-5d590d02a32f-delete_snapshot" released by "delete_snapshot" :: held 3.365s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:13 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5" returned: 0 in 0.761s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:13 devstack sudo[114097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5
Jun 29 05:08:13 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-15f6b484-c71a-4217-85ca-4ae4ab4b6180-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-15f6b484-c71a-4217-85ca-4ae4ab4b6180-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" acquired by "delete_volume" :: waited 0.019s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[12813bf1-1219-4397-94ec-55808f0d0733]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:13 devstack sudo[114099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180
Jun 29 05:08:13 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:13 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-a0c2b746-051d-4410-99c9-282d111965a5" returned: 0 in 0.647s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-quobyte-a0c2b746-051d-4410-99c9-282d111965a5" released by "delete_volume" :: held 1.451s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Created reservations ['73b51b63-5c55-4401-99bc-155c609fecd7', 'd32c5d7f-e24d-4bd7-a90a-99ed1e6648a5', '5733b35b-9f77-479b-9cd5-e11ea20c9b97', '223623f1-c6b4-4942-b7c5-43ebfbc221a8'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:13 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:13 devstack sudo[114102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:08:13 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:14 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180" returned: 0 in 0.744s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:14 devstack sudo[114107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180
Jun 29 05:08:14 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:14 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.676s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:08:14 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Deleted volume successfully.
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-0b788760-5db9-4516-ae27-75093733f518 tempest-SnapshotDependencyTests-1563264765 None] Lock "cinder-a0c2b746-051d-4410-99c9-282d111965a5-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:14 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-15f6b484-c71a-4217-85ca-4ae4ab4b6180" returned: 0 in 0.666s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-15f6b484-c71a-4217-85ca-4ae4ab4b6180" released by "delete_volume" :: held 1.467s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Created reservations ['ae6e3dd0-c60a-4e54-91d5-b6af7ee3e02f', '90990a07-5efe-4928-be62-cf824bfd66e5', '9b48c7bf-7fab-49bc-9d52-45c2ef8377f7', 'fcfad2b4-ab09-4f6d-97ef-f9104c03374a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:14 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:14 devstack sudo[114111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:08:14 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8-delete_volume" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "cinder-quobyte-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" by "delete_volume" {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 29 05:08:15 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.682s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:08:15 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Deleted volume successfully.
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" acquired by "delete_volume" :: waited 0.023s {{(pid=93723) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-5b4538e3-481f-4bb1-a392-efee7ec36011 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-15f6b484-c71a-4217-85ca-4ae4ab4b6180-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77c3216-9f50-4aec-986f-8c08d3fcfc35]: (4, 'qcow2') {{(pid=94976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 29 05:08:15 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:15 devstack sudo[114115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8
Jun 29 05:08:15 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:16 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" returned: 0 in 0.799s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:16 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:16 devstack sudo[114122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8
Jun 29 05:08:16 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00/volume-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" returned: 0 in 0.725s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:17 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-quobyte-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8" released by "delete_volume" :: held 1.602s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG cinder.quota [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Created reservations ['238a80bc-82ac-41c3-b0cc-04fe98bfdabe', '0ea86de3-5e6d-437a-b0dc-d6d8abdfd370', 'ecceb0b1-ae76-48dc-9747-3d971d0c1d05', 'b16c235f-8c0c-49a9-bbcf-a718772e7c5a'] {{(pid=93723) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce': None} {{(pid=93723) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG cinder.volume.drivers.quobyte [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61cdadf9-5873-4bd6-8bbe-323f5e6263ce'] {{(pid=93723) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.lockutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93723) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 29 05:08:17 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00 {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 29 05:08:17 devstack sudo[114161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00
Jun 29 05:08:17 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 29 05:08:18 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root
Jun 29 05:08:18 devstack cinder-volume[93723]: DEBUG oslo_concurrency.processutils [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3de9d6b70664487d1f14605773027d00" returned: 0 in 0.675s {{(pid=93723) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 29 05:08:18 devstack cinder-volume[93723]: DEBUG cinder.manager [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Notifying Schedulers of capabilities ... {{(pid=93723) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 29 05:08:18 devstack cinder-volume[93723]: INFO cinder.volume.manager [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Deleted volume successfully.
Jun 29 05:08:18 devstack cinder-volume[93723]: DEBUG cinder.coordination [None req-a274b8db-4a87-4085-a133-64f1f08fb4d4 tempest-CinderUnicodeTest-1005332463 None] Lock "cinder-9ece7b90-5e87-46b7-b6d3-f375f9b47ff8-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=93723) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 29 05:08:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=49,cinder:INSERT=19,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 29 05:08:36 devstack cinder-volume[93723]: DEBUG dbcounter [-] [93723] Writing DB stats cinder:SELECT=87,cinder:INSERT=32,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=93723) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}